-- Logs begin at Thu 2022-09-15 10:16:17 UTC, end at Thu 2022-09-15 11:25:34 UTC. -- Sep 15 10:45:40.143713 dv-cinder-824149-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 10:45:40.153209 dv-cinder-824149-8-smb devstack@keystone.service[81554]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 10:45:40 2022] *** Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: nodename: dv-cinder-824149-8-smb Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: machine: x86_64 Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: clock source: unix Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: pcre jit disabled Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: detected number of CPU cores: 4 Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: current working directory: / Sep 15 10:45:40.155887 dv-cinder-824149-8-smb devstack@keystone.service[81554]: detected binary path: /usr/bin/uwsgi-core Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: your processes number limit is 47680 Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: your memory page size is 4096 bytes Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: detected max file descriptor number: 2048 Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: lock engine: pthread robust mutexes Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: thunder lock: enabled Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 10:45:40.156595 dv-cinder-824149-8-smb devstack@keystone.service[81554]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 10:45:40.214429 dv-cinder-824149-8-smb devstack@keystone.service[81554]: Python main interpreter initialized at 0x557009d5a9c0 Sep 15 10:45:40.214429 dv-cinder-824149-8-smb devstack@keystone.service[81554]: python threads support enabled Sep 15 10:45:40.214429 dv-cinder-824149-8-smb devstack@keystone.service[81554]: your server socket listen backlog is limited to 100 connections Sep 15 10:45:40.214429 dv-cinder-824149-8-smb devstack@keystone.service[81554]: your mercy for graceful operations on workers is 90 seconds Sep 15 10:45:40.214842 dv-cinder-824149-8-smb devstack@keystone.service[81554]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 10:45:40.214842 dv-cinder-824149-8-smb devstack@keystone.service[81554]: *** Operational MODE: preforking *** Sep 15 10:45:40.215144 dv-cinder-824149-8-smb devstack@keystone.service[81554]: *** uWSGI is running in multiple interpreter mode *** Sep 15 10:45:40.215144 dv-cinder-824149-8-smb devstack@keystone.service[81554]: spawned uWSGI master process (pid: 81554) Sep 15 10:45:40.215357 dv-cinder-824149-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 10:45:40.216148 dv-cinder-824149-8-smb devstack@keystone.service[81554]: spawned uWSGI worker 1 (pid: 81564, cores: 1) Sep 15 10:45:40.216277 dv-cinder-824149-8-smb devstack@keystone.service[81554]: spawned uWSGI worker 2 (pid: 81565, cores: 1) Sep 15 10:45:40.216550 dv-cinder-824149-8-smb devstack@keystone.service[81554]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 10:45:44.600135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 10:45:44.600135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: from cryptography.utils import int_from_bytes Sep 15 10:45:44.601003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 10:45:44.601003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: from cryptography.utils import int_from_bytes Sep 15 10:45:44.602574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 10:45:44.602574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: from cryptography.utils import int_from_bytes Sep 15 10:45:44.603048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 10:45:44.603048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: from cryptography.utils import int_from_bytes Sep 15 10:45:44.652489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 10:45:44.652665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 10:45:44.652859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] command line args: [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 10:45:44.653129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 10:45:44.653306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ================================================================================ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 10:45:44.653559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] admin_token = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.653679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 10:45:44.653883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_dir = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.654494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 10:45:44.654628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] command line args: [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 10:45:44.654748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.654830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_source = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.654892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 10:45:44.654992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] debug = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.655092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ================================================================================ {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 10:45:44.655199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.655465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] admin_token = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.655530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] config_dir = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.655592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] config_source = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] debug = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.656981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_config_append = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_dir = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_config_append = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.657970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_dir = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_file = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.658960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.659927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.660983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] publish_errors = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.661939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.662172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.662408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] standard_threads = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.662525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.662638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] publish_errors = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.662791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.662993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_journal = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_json = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_stderr = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.663921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.664034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_syslog = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.664147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.664269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.664418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] standard_threads = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.664534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.664647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.664765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.664879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.665002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.665124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.665124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] use_journal = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.665351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.665473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] use_json = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.665587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.665711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] use_stderr = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.665711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] use_syslog = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.665933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 10:45:44.666167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.666915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.667976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.668948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.669915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.670934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.671859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.672897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.673951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.674912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.675936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.676967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.677996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.678888 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.679842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.680027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.680123 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.680230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.684707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.684835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.684913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.685988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686152 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.686957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.687962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688888 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.688963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.689963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.external = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.password = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.690953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.token = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.691936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.external = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.692926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.password = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] auth.token = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.693829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.694952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.695998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.696971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.697940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.698912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.699995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.700123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.700244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.701998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.702909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.703914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.704887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705604 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.705998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.706956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.707919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.708942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.709945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.710898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.711998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.712969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.713910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.714854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.715857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.716015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.716101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.716251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.716974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.717855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.718960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.719976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.720884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.721930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.722882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.723999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.724984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.725934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.726926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] role.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.727938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] role.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.728930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.729965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.730908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.731955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732817 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.732894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.733850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.734963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.735955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.736032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.736192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.736269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.741935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742152 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.742992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.connection = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.743487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.744791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.745037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.745278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 10:45:44.745450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 10:45:44.769398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.769629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.769853 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.771119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.771358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.771591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.778151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.780730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.806710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.806943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.808754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.808993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.860205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.860528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.908747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.908983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.910610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:44.910848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.063191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.063416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.063559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.063672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.063800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.063883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.064029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.064111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.064248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.064364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.064510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.064731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.086835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.087951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.088032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.088161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.088252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.088434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.099935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.100279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.113259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.113446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.113923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.114992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.115214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.115433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 10:45:45.131333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.131481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.131565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 10:45:45.131696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 10:45:45.131867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.132038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.132119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 10:45:45.132243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 10:45:45.132344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.132557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.132642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.132823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.132903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.133084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.133172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.133344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.142638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.142916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.143129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.143212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.143412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.143495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.143685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.143971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.150346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.151032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.153245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.153529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.154355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.154487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.154775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.154857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.155946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.156979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.157252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.179364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.179859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.180851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.181133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.181363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.181652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.185880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.186163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.186348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.186444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.186636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.186920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.192746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.193293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.193582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.198580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.198877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.199168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.199455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.199549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.199730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.199851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.200002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.200142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.200269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.200454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.200560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.201266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.201553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.201907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.202184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.216617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.216904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.218058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.218341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.220751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.222176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.223950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.224247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.225384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.225684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.228522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.229835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.231599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.233493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.235501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.235802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.236086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.236400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.236681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.236776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.236958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.237039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.237257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.237547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.238078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.238373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.252738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.253026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.253294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.253557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.254463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.254755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.255026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.255295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.260254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.261774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.262207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.263793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.264064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.264283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.265845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.266127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.266707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.266992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.267281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.267564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.267948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.268952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.269248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.269535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.269821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.270217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.279126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.279411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.279693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.279975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.280381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.280672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.280952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.281478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.281767 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.282053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.282340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.282731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.283011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.283300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.296866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.299372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.299743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.302332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.302631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.304116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.305264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.305607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.305891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.306285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.306752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.308212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.308524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.308939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.313468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.314692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.317101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.317651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.318110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.318584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.319311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.320831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.323721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.324123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.324448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.324735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.332536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.332832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.333114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.333358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.333655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.333943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.339952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.340237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.340544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.340821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.340916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 10:45:45.341094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.341177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.341930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.342224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.342319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.342688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.342787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.342863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.342937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.343905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.344102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.344184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.344400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.344668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.344946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.345225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 10:45:45.378194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557009d5a9c0 pid: 81564 (default app) Sep 15 10:45:45.380424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557009d5a9c0 pid: 81565 (default app) Sep 15 10:45:45.381414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b48718-8f07-40ac-b21e-a6c61a51b467 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:45.381700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b48718-8f07-40ac-b21e-a6c61a51b467 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:45.381970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b48718-8f07-40ac-b21e-a6c61a51b467 None None] PATH_INFO: `/v3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:45.386127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Sep 15 10:45:45 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:45:53.015727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:53.016250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:53.016250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:53.020515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:45:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:45:53.025962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:53.031481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:53.031481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:53.099438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: INFO dbcounter [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] Registered counter for database keystone Sep 15 10:45:53.118729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 10:45:53.125529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writer thread running {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 10:45:53.307844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG passlib.handlers.bcrypt [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81564) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 10:45:53.308153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG passlib.handlers.bcrypt [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81564) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 10:45:53.369830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:45:53.371459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:45:53.503639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:45:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 15 10:45:53.976083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:54.045945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: INFO dbcounter [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] Registered counter for database keystone Sep 15 10:45:54.067060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG oslo_db.sqlalchemy.engines [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 10:45:54.073207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writer thread running {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 10:45:54.191008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999ee75-a90f-4640-975f-85c0a0cdd250 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:54.195191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:54.195813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:54.196094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:54.196389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:54.204984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:54.256053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 10:45:54.256343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1705-51e5-4285-ba82-dc6931bec179 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:54.266343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Sep 15 10:45:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 10:45:54.272235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:54.289603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe318c-420d-49cb-89a0-6527d6942308 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:54.293983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:54.295191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:54.295457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:54.295730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] PATH_INFO: `/v3/projects/fcc2355d0a64457f8c16a6298a1d7815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:54.297336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=fcc2355d0a64457f8c16a6298a1d7815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:54.350001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 10:45:54.350345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62acc7-985a-4799-90cb-da498cd330f0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:54.354822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Sep 15 10:45:54 2022] GET /identity/v3/projects/fcc2355d0a64457f8c16a6298a1d7815 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:45:56.492171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecdc5f-f552-4624-a053-4dfcb162284f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:56.492720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecdc5f-f552-4624-a053-4dfcb162284f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:56.492833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecdc5f-f552-4624-a053-4dfcb162284f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:56.496880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:45:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:45:56.502341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:56.502750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:56.502885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:56.522828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:45:56.524359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:45:56.532887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:45:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 10:45:56.802630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecdc5f-f552-4624-a053-4dfcb162284f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:56.814963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecdc5f-f552-4624-a053-4dfcb162284f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:56.819128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc9407-f65d-42bc-bf13-9ac53b2a1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:56.819754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc9407-f65d-42bc-bf13-9ac53b2a1d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:56.820035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc9407-f65d-42bc-bf13-9ac53b2a1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:56.820314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc9407-f65d-42bc-bf13-9ac53b2a1d8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:56.828482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc9407-f65d-42bc-bf13-9ac53b2a1d8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:56.830241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc9407-f65d-42bc-bf13-9ac53b2a1d8b admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:56.838757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Sep 15 10:45:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 10:45:56.843957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:56.852822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bee1e-37c6-4126-9667-2c9d8fb014b0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:56.857556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4988c-00ce-49d0-a9d5-5f4629276ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:56.857810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4988c-00ce-49d0-a9d5-5f4629276ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:56.858084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4988c-00ce-49d0-a9d5-5f4629276ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:56.858352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4988c-00ce-49d0-a9d5-5f4629276ea5 admin admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:56.859627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4988c-00ce-49d0-a9d5-5f4629276ea5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:56.861802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4988c-00ce-49d0-a9d5-5f4629276ea5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:56.863303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Sep 15 10:45:56 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:45:59.083343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4cb7-07a2-4cc7-855f-748eff3a25a9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.083853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4cb7-07a2-4cc7-855f-748eff3a25a9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.083853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4cb7-07a2-4cc7-855f-748eff3a25a9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.085221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:45:59.090392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.090805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.091007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.109178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:45:59.110366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:45:59.137875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e89e8-4361-4461-bed4-fadada09559a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.138154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e89e8-4361-4461-bed4-fadada09559a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.138995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e89e8-4361-4461-bed4-fadada09559a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.140409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:45:59.145541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10463-395f-43a8-8603-420b7102530a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.145959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10463-395f-43a8-8603-420b7102530a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.146102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10463-395f-43a8-8603-420b7102530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.187420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG passlib.handlers.bcrypt [None req-d8e10463-395f-43a8-8603-420b7102530a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81565) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 10:45:59.187809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG passlib.handlers.bcrypt [None req-d8e10463-395f-43a8-8603-420b7102530a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81565) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 10:45:59.191818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:45:59.236749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d8e10463-395f-43a8-8603-420b7102530a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:45:59.238304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d8e10463-395f-43a8-8603-420b7102530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:45:59.338945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:45:59.473714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:59.498270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:45:59.578381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104eb8d-503f-4dc2-887f-ab804a89eb35 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:59.612232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:59.612916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.613203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.613491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.614929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10463-395f-43a8-8603-420b7102530a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:59.626117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:45:59.639196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:45:59.640208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:45:59.641012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:45:59.647835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:59.721182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10463-395f-43a8-8603-420b7102530a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:59.723427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:45:59.728463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:45:59.746807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ad83c-2a46-4316-aa49-519f15665802 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:59.756841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:59.757700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.757982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.758256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.781883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:59.782493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.782769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.783042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.783710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:45:59.784012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:59.785436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:59.797130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:45:59.802696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:59.826661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:59.828178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:59.901453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c5772-f171-4a1c-ac45-c0fa6d0ffc3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:45:59.923707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:45:59.930371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:59.933415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:45:59.943778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:45:59.944532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:45:59.944815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:45:59.945093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:45:59.946276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:45:59.947724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:45:59.949502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:45:59 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:45:59.954969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:45:59.969815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:00.027242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915dd20-6fff-4f49-b164-4a0327a4ca0f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:00.054341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7d7d-e7e3-4030-bbda-37b108c2c99e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:00.063873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:00.064752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:00.065036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:00.065314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:00.083620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:00.085107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:00.089949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:00.090582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:00.091057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:00.091137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:00.092790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:00.094230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:00.095983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:45:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:00.101478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:46:00.103723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:00.104745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:46:00.105894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:46:00.105894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:46:00.105894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:00.105894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:46:00.110824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:00.173817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:00.182605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:00.202018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba30af-6d0e-46dc-adc3-92a26abddca2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:00.218740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ed38-944c-4f50-ba3e-f7e40406fa16 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:00.235925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:00.236569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:00.236852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:00.237121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:00.237841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.domain.id=default, user.id=3ee61658b90f47ef8962c8e9a5f6c521) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:00.238141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:00.239836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3457aaf-bb10-47ae-acb5-29bb892da9b1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:00.246377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Sep 15 10:46:00 2022] GET /identity/v3/role_assignments?user.id=3ee61658b90f47ef8962c8e9a5f6c521&scope.domain.id=default&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:00.251718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:00.252484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:00.252854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:00.253170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:00.253932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:00.254233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:00.255649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32109-1d34-4dd4-a095-b8586e42cff5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:00.275328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:02.848619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1115-309e-4b11-bbab-70dc78d66413 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:02.849137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1115-309e-4b11-bbab-70dc78d66413 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:02.849137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1115-309e-4b11-bbab-70dc78d66413 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:02.850508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:02.866097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57902-1313-49d1-a9f5-546c603479e3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:02.866626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57902-1313-49d1-a9f5-546c603479e3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:02.866626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57902-1313-49d1-a9f5-546c603479e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:02.897554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c8b57902-1313-49d1-a9f5-546c603479e3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:02.898781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c8b57902-1313-49d1-a9f5-546c603479e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:02.991108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:03.012511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55d22-fe0c-405b-bb98-a911d0db9305 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.012823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55d22-fe0c-405b-bb98-a911d0db9305 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.013062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55d22-fe0c-405b-bb98-a911d0db9305 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.016593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:03.020976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.021495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.021993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.029018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e54f-6f8b-4c13-8235-137f85c7a41d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.029292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e54f-6f8b-4c13-8235-137f85c7a41d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.029570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e54f-6f8b-4c13-8235-137f85c7a41d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.031301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 14/25] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:03.038847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b71a42-a5df-4b53-b6a0-9316b074a5f9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.039130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b71a42-a5df-4b53-b6a0-9316b074a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.039412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b71a42-a5df-4b53-b6a0-9316b074a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.042143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:03.043432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:03.077770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c7b71a42-a5df-4b53-b6a0-9316b074a5f9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:03.078968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c7b71a42-a5df-4b53-b6a0-9316b074a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:03.105721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:03.174216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 12/26] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:03.220126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:03.304849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:03.422591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68976ad-b38a-4058-ab83-15be317f15ff None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:03.471598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:03.472238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.472538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.472810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.492348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:03.499584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:03.500594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:03.501342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:03.503172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:03.504748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20859b-a989-44b2-934c-a95f9686e8d4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.505033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20859b-a989-44b2-934c-a95f9686e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.505297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20859b-a989-44b2-934c-a95f9686e8d4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.506813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 16/29] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:03.512012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:03.529788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.530097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.530326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.554662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:03.556171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:03.589929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:03.688003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 17/30] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:03.694954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:03.699889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f510-c18c-4623-8b64-b45b995bd168 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:03.704341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:03.739805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:03.740806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.741292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.741759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.742612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:03.743115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:03.744749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:03.759784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 14/31] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:03.760903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:03.866059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:03.868375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f9e36-ec59-4d69-b96d-c1af83b75611 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:03.905570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:03.906527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.906995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.907476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.908882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:03.910516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:03.930791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4711c-fb26-4e4d-98e7-e60199e94e41 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:03.968099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:03.969020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:03.969494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:03.969943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:03.982590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:03.985224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:46:04.019972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:04.021025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:46:04.021869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:46:04.021869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:46:04.021869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:04.024467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 18/32] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:04.025506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:04.091173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:04.142886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66b53c-3dba-43dc-9282-6f981c7151ad None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:04.156684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 15/33] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 15 10:46:03 2022] POST /identity/v3/roles => generated 219 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:04.158004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:04.190731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:04.191660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.192078 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.192524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.195464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:04.197157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.203967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 19/34] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:04 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:04.205141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:04.369154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19dd1-b4e3-4b81-b65f-03bc9a959c25 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:04.407493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a6ce5-5605-4f4e-8947-acf7b9a431f9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:04.421889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:04.421889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.422214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.422548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.423380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:04.426050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.443186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:04.454969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:04.455595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.455872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.456142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.456874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:04.457175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:04.458591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.482095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 20/35] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:04.483810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:04.549328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 16/36] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 15 10:46:04 2022] POST /identity/v3/roles => generated 225 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:04.555565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:04.582281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:04.604697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa939b-44a3-43d2-9225-1831552577ef None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:04.653537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bd2f3-d70c-4983-95ea-ab656c939b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:04.654953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd2f3-d70c-4983-95ea-ab656c939b3c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.655231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd2f3-d70c-4983-95ea-ab656c939b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.655495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd2f3-d70c-4983-95ea-ab656c939b3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.656722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd2f3-d70c-4983-95ea-ab656c939b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:04.658303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bd2f3-d70c-4983-95ea-ab656c939b3c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.660247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 21/37] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:04.661391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbe89b-65f8-42a1-b38b-83f727ad148e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.661677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbe89b-65f8-42a1-b38b-83f727ad148e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.661953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbe89b-65f8-42a1-b38b-83f727ad148e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.663451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 22/38] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:04.665905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbe89b-65f8-42a1-b38b-83f727ad148e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:04.699847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586236d6-14a7-44a7-af06-0e0398105213 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:04.739572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9691b-bf1c-486e-9e98-de6d62c5f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:04.740198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9691b-bf1c-486e-9e98-de6d62c5f326 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.740508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9691b-bf1c-486e-9e98-de6d62c5f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.740784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9691b-bf1c-486e-9e98-de6d62c5f326 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.742521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9691b-bf1c-486e-9e98-de6d62c5f326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:04.743139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9691b-bf1c-486e-9e98-de6d62c5f326 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.745932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:04.805929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbe89b-65f8-42a1-b38b-83f727ad148e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:04.840084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:04.840799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.841057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.841332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] PATH_INFO: `/v3/domains/default/users/3ee61658b90f47ef8962c8e9a5f6c521/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.844011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3ee61658b90f47ef8962c8e9a5f6c521, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:04.845505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:04.883522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 17/39] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:46:04 2022] POST /identity/v3/projects => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:04.884998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b8d7-7931-4f00-b0ed-4bc12c123e7b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.885288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b8d7-7931-4f00-b0ed-4bc12c123e7b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.885564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b8d7-7931-4f00-b0ed-4bc12c123e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.906466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-7e31b8d7-7931-4f00-b0ed-4bc12c123e7b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:04.907964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7e31b8d7-7931-4f00-b0ed-4bc12c123e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:04.979866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:04.996357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 18/40] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:04.996357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44b39-aeca-43ed-8202-7914207a9cfd None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:04.996357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44b39-aeca-43ed-8202-7914207a9cfd None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:04.996357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f44b39-aeca-43ed-8202-7914207a9cfd None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:04.996357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 19/41] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:04.998764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751446-24a5-411b-ba6b-060db289a461 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:05.000535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751446-24a5-411b-ba6b-060db289a461 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:05.001061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751446-24a5-411b-ba6b-060db289a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:05.026457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-00751446-24a5-411b-ba6b-060db289a461 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:05.031634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-00751446-24a5-411b-ba6b-060db289a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:05.052905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 23/42] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Sep 15 10:46:04 2022] PUT /identity/v3/domains/default/users/3ee61658b90f47ef8962c8e9a5f6c521/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:05.109619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:05.271819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:05.384763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751446-24a5-411b-ba6b-060db289a461 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:05.484873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5615fd9-39ff-477b-b229-8fcfe28203d8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:05.496361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751446-24a5-411b-ba6b-060db289a461 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:05.502889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:05.524571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e050-9f11-417a-ab85-eec87d7eb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:05.525206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e050-9f11-417a-ab85-eec87d7eb613 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:05.525491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e050-9f11-417a-ab85-eec87d7eb613 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:05.525769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e050-9f11-417a-ab85-eec87d7eb613 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:05.526449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242e050-9f11-417a-ab85-eec87d7eb613 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:05.528050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242e050-9f11-417a-ab85-eec87d7eb613 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:05.534658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:05.541319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:05.541963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:05.542245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:05.542519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:05.543742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:05.545867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:05.547460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 21/44] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:05.553313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:05.625904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 24/45] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 15 10:46:05 2022] POST /identity/v3/roles => generated 223 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:05.660037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272de1e2-b2f6-49ff-a891-b70cbb081c63 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:05.697695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b7253-965e-4066-94b2-74d7678e59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:05.698326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b7253-965e-4066-94b2-74d7678e59c7 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:05.698605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b7253-965e-4066-94b2-74d7678e59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:05.698881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b7253-965e-4066-94b2-74d7678e59c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:05.699549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b7253-965e-4066-94b2-74d7678e59c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:05.701223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b7253-965e-4066-94b2-74d7678e59c7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:05.776435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 22/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:46:05 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:46:07.227913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906071-7fcb-4563-87eb-731e158164d5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:07.228474 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906071-7fcb-4563-87eb-731e158164d5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:07.228556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906071-7fcb-4563-87eb-731e158164d5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:07.229870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 25/47] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:07.235753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:07.236129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:07.236472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:07.255020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:07.256203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:07.302144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:07.327276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:07.604159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae906071-7fcb-4563-87eb-731e158164d5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:07.707978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae906071-7fcb-4563-87eb-731e158164d5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:07.741818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627192-8561-4ac6-9635-5b0fb0b08027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:07.742444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627192-8561-4ac6-9635-5b0fb0b08027 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:07.742725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627192-8561-4ac6-9635-5b0fb0b08027 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:07.743002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627192-8561-4ac6-9635-5b0fb0b08027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:07.753558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627192-8561-4ac6-9635-5b0fb0b08027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-35627192-8561-4ac6-9635-5b0fb0b08027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:07.758341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:07.759373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:07.760335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 26/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:07.767300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:07.970126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685616-a452-4ea4-b6a7-382e3fbbd5e4 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:07.975913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb163-c18c-443f-b069-6c5bd5caec71 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:07.976196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb163-c18c-443f-b069-6c5bd5caec71 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:07.976507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb163-c18c-443f-b069-6c5bd5caec71 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:07.977855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 27/50] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:07.983236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:07.983519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:07.983794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.002418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:08.003929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:08.004758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:08.005368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:08.005651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:08.005925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.006581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:08.006883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:08.008240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:08.016352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 24/51] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:08.021953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:08.030784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:08.065523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:08.073792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 28/52] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:08.119601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7d4ca-f187-4a4f-b24b-800c97d812a6 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:08.151561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:08.152186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:08.152494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:08.152770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.154281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:08.155754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:08.157356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:08 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:08.162894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:08.259550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d601b-a1dd-42af-98db-b85eb4bea4f5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:08.291631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:08.292246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:08.292554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:08.292828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.293907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:08.295930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:08.297486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 29/54] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:08.303426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:08.346259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:08.377088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:08.403287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a96412-af3b-4936-9f57-bfeb369a76d9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:08.414281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:08.438957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:08.439566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:08.439853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:08.440129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.440933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.domain.id=default, user.id=3ee61658b90f47ef8962c8e9a5f6c521) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:08.441435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:08.443166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:08.446535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec156b-288a-4e82-ae5d-93ebc20889aa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:08.453057 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 26/55] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Sep 15 10:46:08 2022] GET /identity/v3/role_assignments?user.id=3ee61658b90f47ef8962c8e9a5f6c521&scope.domain.id=default&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:08.484297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e237e2-079a-401c-8d1a-1fd55a943e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:08.484979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e237e2-079a-401c-8d1a-1fd55a943e6f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:08.485258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e237e2-079a-401c-8d1a-1fd55a943e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:08.485528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e237e2-079a-401c-8d1a-1fd55a943e6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.486683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e237e2-079a-401c-8d1a-1fd55a943e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:08.488162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e237e2-079a-401c-8d1a-1fd55a943e6f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:08.490098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 30/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:08.495776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:08.600541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10f921-a1d7-4678-95bf-b942bac3b945 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:08.636124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dbeb6-4883-4f81-aa17-02b3a5c7a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:08.636774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dbeb6-4883-4f81-aa17-02b3a5c7a21c None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:08.637051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dbeb6-4883-4f81-aa17-02b3a5c7a21c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:08.637323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dbeb6-4883-4f81-aa17-02b3a5c7a21c None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:08.637975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dbeb6-4883-4f81-aa17-02b3a5c7a21c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:08.639422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dbeb6-4883-4f81-aa17-02b3a5c7a21c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:08.729065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 27/57] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Sep 15 10:46:08 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:10.946474 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fe5e8-3b74-47a2-87c2-fe09b3b88f9a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:10.946989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fe5e8-3b74-47a2-87c2-fe09b3b88f9a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:10.947072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fe5e8-3b74-47a2-87c2-fe09b3b88f9a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:10.948448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 31/58] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:10.954274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:10.954715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:10.954826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:10.973850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:10.975024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:10.995707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:11.049263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:11.319648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fe5e8-3b74-47a2-87c2-fe09b3b88f9a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:11.416069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:11.420862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fe5e8-3b74-47a2-87c2-fe09b3b88f9a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:11.453183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cca99-ef67-4639-a571-8fee82ed7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:11.453803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cca99-ef67-4639-a571-8fee82ed7af1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:11.454081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cca99-ef67-4639-a571-8fee82ed7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:11.454354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cca99-ef67-4639-a571-8fee82ed7af1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:11.455449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cca99-ef67-4639-a571-8fee82ed7af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:11.456926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cca99-ef67-4639-a571-8fee82ed7af1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:11.458458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 32/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:11.464095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:11.562812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cb7d8-df5f-4dc9-95e9-9073fceefcc5 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:11.597402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc7891-b20a-4fe5-997b-e9e8794d6a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:11.597548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7891-b20a-4fe5-997b-e9e8794d6a32 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:11.597788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7891-b20a-4fe5-997b-e9e8794d6a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:11.598065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc7891-b20a-4fe5-997b-e9e8794d6a32 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:11.598728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7891-b20a-4fe5-997b-e9e8794d6a32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:11.600159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc7891-b20a-4fe5-997b-e9e8794d6a32 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:11.705801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 29/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:11 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:15.127742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b132b-c30c-46fb-b9e4-952f64f19f87 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.128759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b132b-c30c-46fb-b9e4-952f64f19f87 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.129279 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b132b-c30c-46fb-b9e4-952f64f19f87 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.130968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 33/62] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:15.137200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0e80-c34d-4110-98e8-f9f4bd6f373b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.138180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0e80-c34d-4110-98e8-f9f4bd6f373b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.138719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d0e80-c34d-4110-98e8-f9f4bd6f373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.166223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-343d0e80-c34d-4110-98e8-f9f4bd6f373b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:15.167759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-343d0e80-c34d-4110-98e8-f9f4bd6f373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:15.182582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:15.192805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1337920-8088-4cfc-9bd0-eccbb9015202 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.193091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1337920-8088-4cfc-9bd0-eccbb9015202 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.197726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1337920-8088-4cfc-9bd0-eccbb9015202 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.197726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 34/63] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:15.207709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68483-4789-44fc-8c92-7f7923e04ef0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.208000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68483-4789-44fc-8c92-7f7923e04ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.208286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68483-4789-44fc-8c92-7f7923e04ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.231931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-14d68483-4789-44fc-8c92-7f7923e04ef0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:15.237857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-14d68483-4789-44fc-8c92-7f7923e04ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:15.281227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 30/64] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:15.289816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82ec9-9ee2-47ee-ab98-27c414292de0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.290277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82ec9-9ee2-47ee-ab98-27c414292de0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.290705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82ec9-9ee2-47ee-ab98-27c414292de0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.292169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 31/65] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:15.299894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b91d-f9a3-49a0-a540-8bacee221c6f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.300450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b91d-f9a3-49a0-a540-8bacee221c6f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.300874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b91d-f9a3-49a0-a540-8bacee221c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.317459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 35/66] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:15.326733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6b77b91d-f9a3-49a0-a540-8bacee221c6f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:15.328138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6b77b91d-f9a3-49a0-a540-8bacee221c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:15.396945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:15.634995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130481-533d-4425-8270-ff9136d20050 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.635679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130481-533d-4425-8270-ff9136d20050 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.636198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0130481-533d-4425-8270-ff9136d20050 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.637788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 36/68] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:15.643523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a86f-08f5-4e6d-890d-a612102df657 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.643816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a86f-08f5-4e6d-890d-a612102df657 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.644102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a86f-08f5-4e6d-890d-a612102df657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.654587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130481-533d-4425-8270-ff9136d20050 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:15.673353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9634a86f-08f5-4e6d-890d-a612102df657 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:15.674552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9634a86f-08f5-4e6d-890d-a612102df657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:15.748119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 33/69] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:15.749624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c3ee-7b66-458c-bf04-fd093b087d3e None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.750061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c3ee-7b66-458c-bf04-fd093b087d3e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c3ee-7b66-458c-bf04-fd093b087d3e None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.751916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 34/70] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:15.752848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c3ee-7b66-458c-bf04-fd093b087d3e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:15.756653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:15.773136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:15.780169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0130481-533d-4425-8270-ff9136d20050 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:15.815539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d756b1-a586-4946-9519-efff3890dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:15.816326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d756b1-a586-4946-9519-efff3890dac7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.816723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d756b1-a586-4946-9519-efff3890dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.817018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d756b1-a586-4946-9519-efff3890dac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.827472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d756b1-a586-4946-9519-efff3890dac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f7d756b1-a586-4946-9519-efff3890dac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:15.832254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:15.833862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:15.835353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 37/71] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:46:15.839245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.839532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.839814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.858486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:15.859656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:15.875711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c3ee-7b66-458c-bf04-fd093b087d3e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:15.912011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:15.912599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:15.912905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:15.913174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:15.925447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:15.930315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:15.931196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 35/72] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:15.933046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:15.937779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:15.938802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.008658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.041228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.054395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e02d-a1a3-4da2-95c6-5a2a756bd016 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.057023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8668d-c5be-4f17-bc88-8ab63656a987 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.090397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.091029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.091330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.091753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.093414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.094092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.094461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.094808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.095478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:16.095784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.097212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.103477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:16.105692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 39/74] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.106476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:16.110287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:16.111497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:16.112387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 36/75] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:16.113119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.217849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c72b0-5d75-4698-a9f1-7aace8aa548d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.223551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15df5-f1cb-4102-ab90-117ab5410637 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.246609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.253308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.253929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.254215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.254495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.255163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:16.255527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.256893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.257829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.258456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.258731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.259008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.260108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.261574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.263217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 37/76] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.269374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 40/77] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.269374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.269569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.278212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.364207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289cf60-be71-41de-8f55-ab3e43412748 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.369007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330634a8-1dc3-4bf6-b65c-aeda2a8199e1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.401365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.401994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.402199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.402301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.402540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.402808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.403093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.403372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.403657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.404577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:16.404889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.406088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.406244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.407667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 38/78] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.412944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.414356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 41/79] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.414999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.474786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.487239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.514766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9215b-c3eb-40d6-a8f8-97669965480a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.516251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f44f89-76f3-46f4-baf6-e8e9630389d6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.548062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.548718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.549004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.549283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.550321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.551002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.551293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.551573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.552229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.553711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.559246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:16.564694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:16.565708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 39/80] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:16.566603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.642413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 42/81] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:16 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:16.643706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.681263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db6da-b16a-4d62-b591-a1fd55ab07c9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.703020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.724241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.724995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.725639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.725929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.746171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.747983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.750335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 40/82] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.751074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.760357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb84cad-4204-4607-b713-ba3b51226df5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.791724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:16.800774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.801410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.801697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.801974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.872028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e38be-7ed3-40af-8941-fbc7acf0801e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:16.884769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.887123 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.914887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:16.915527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:16.915820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:16.916101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:16.917447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:16.918896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:16.925949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 41/83] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:16.925949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:16.983771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.023550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:17.024519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.054778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5232-e067-44cd-9d99-d8f5cf9aef6f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.065083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.096908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.097620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.097974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.098321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.099398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:17.099774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.102446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.113749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 42/85] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:17.118754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.156052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979945-26b0-42e6-a175-bced9ab47a42 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.208612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.210185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.210676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.211618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.236334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644edfc-e38d-4120-bb62-2a5945ac6a2b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.244532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.274940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.276550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.277312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.277793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.300188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.301823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.331149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.366914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.368424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.434744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:17.434744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.501427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 43/87] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:17.502556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.514203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.556293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e44a-338a-4261-baac-963f451c0bf0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.600262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.613240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.614084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.614555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.615262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.615763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eca19-b5ea-417e-a8ad-56257d03635a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.616927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.619740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.621888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 45/88] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:17.623679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.667194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.667886 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.668171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.668498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.670474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.672141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.674068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 44/89] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:17.674795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.759576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713283b1-a951-43cd-b428-a6bf7114de1c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.770279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.800929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89fbf1-996a-43ef-85d5-807706e63620 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.803010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.803758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.804046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.804334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.805483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.818045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.818045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:17.818045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.838505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.841943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.841943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.841943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.841943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.843163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:17.844978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:17.845589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:17.892493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:17.939288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd344-36c6-4704-9ca1-e19a1e3a9386 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.973985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0adbd-6661-4dc7-b956-a862c81db2cf None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:17.982608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:17.983659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:17.984013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:17.984392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:17.985566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=3ee61658b90f47ef8962c8e9a5f6c521) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:17.985962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:17.987753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:18.000353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/role_assignments?user.id=3ee61658b90f47ef8962c8e9a5f6c521&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:18.000353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:18.046047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:18.046674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:18.046958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:18.047233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:18.075544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:18.151141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:18.153086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:18.250528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcf0b1-30e2-4466-a8b2-87f9aacc7a19 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:18.281735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:18.289707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 46/93] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:18.291168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:18.296347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393025-faea-4486-9137-afda0af53109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:18.296836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393025-faea-4486-9137-afda0af53109 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:18.297121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393025-faea-4486-9137-afda0af53109 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:18.297416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393025-faea-4486-9137-afda0af53109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:18.298147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393025-faea-4486-9137-afda0af53109 None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=0c82e614439e49fc961d933b5aa45282) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:18.298466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393025-faea-4486-9137-afda0af53109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:18.300021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93393025-faea-4486-9137-afda0af53109 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:18.318594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 48/94] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:17 2022] GET /identity/v3/role_assignments?user.id=0c82e614439e49fc961d933b5aa45282&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=35a5b624e6db4cad87cd57e909000815 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:18.319291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393025-faea-4486-9137-afda0af53109 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:18.346852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:18.418844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b77a3-d828-44c2-9857-f84e4c828156 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:18.470695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:18.471707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:18.472185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:18.472706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:18.473645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] RBAC: Adding query filter params (role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=0c82e614439e49fc961d933b5aa45282) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:18.475967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:18.477747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:18.491273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 47/95] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:18 2022] GET /identity/v3/role_assignments?user.id=0c82e614439e49fc961d933b5aa45282&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=9efddb790ba641d59d0f165b116e2876 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:18.535566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393025-faea-4486-9137-afda0af53109 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:18.580372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531767f9-9512-4751-8bcd-de6442c6098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:18.581396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531767f9-9512-4751-8bcd-de6442c6098c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:18.581876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531767f9-9512-4751-8bcd-de6442c6098c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:18.582366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531767f9-9512-4751-8bcd-de6442c6098c None admin] PATH_INFO: `/v3/projects/58ce6f0785054b41833335e927aead7a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:18.589358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531767f9-9512-4751-8bcd-de6442c6098c None admin] RBAC: Authorizing `identity:get_project(project_id=58ce6f0785054b41833335e927aead7a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:18.591252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531767f9-9512-4751-8bcd-de6442c6098c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:18.594340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 49/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:18 2022] GET /identity/v3/projects/58ce6f0785054b41833335e927aead7a => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:18.600052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:18.739583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81060f8-b362-417c-bf94-06c7e980c0da None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:18.748695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:18.776627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:18.777241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:18.777518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:18.777796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:18.778578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=58ce6f0785054b41833335e927aead7a, user.id=0c82e614439e49fc961d933b5aa45282) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:18.779415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:18.780885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c5bf-716c-4f6b-9634-ebf0f65c2102 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:18.787306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:18 2022] GET /identity/v3/role_assignments?user.id=0c82e614439e49fc961d933b5aa45282&scope.project.id=58ce6f0785054b41833335e927aead7a&role.id=35a5b624e6db4cad87cd57e909000815 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:19.295677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303ab0-c25e-48af-964e-e2b77c8da833 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:19.296184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303ab0-c25e-48af-964e-e2b77c8da833 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:19.296630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303ab0-c25e-48af-964e-e2b77c8da833 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:19.298133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 50/98] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:19.314681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684d762-21ef-47ae-860c-7c734d893ba2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:19.315596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684d762-21ef-47ae-860c-7c734d893ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:19.316162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684d762-21ef-47ae-860c-7c734d893ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:19.345175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4684d762-21ef-47ae-860c-7c734d893ba2 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:19.346742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4684d762-21ef-47ae-860c-7c734d893ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:19.439452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:19.628932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8531-d4a3-4df4-813a-478e1b0c4713 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:19.630132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8531-d4a3-4df4-813a-478e1b0c4713 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:19.630610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa8531-d4a3-4df4-813a-478e1b0c4713 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:19.632540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 51/100] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:19.638822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:19.639333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:19.639817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:19.665244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:19.666745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:19.762548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:19.821596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa8531-d4a3-4df4-813a-478e1b0c4713 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:19.898046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:19.947468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa8531-d4a3-4df4-813a-478e1b0c4713 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:19.991550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:19.992184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:19.992500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:19.992778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:20.007124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:20.012581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:20.013461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:20.014624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 52/102] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:20.019735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:20.080680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:20.190084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dc2e6-09f5-44d0-8747-626c2223197e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:20.238880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:20.239498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:20.240040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:20.240334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:20.241010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:20.241313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:20.242683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:20.255854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 51/103] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:20.261473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:20.269348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:20.369130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8373b-500e-41b2-b6b6-a8252b807ccd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:20.391103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:20.417048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:20.417967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:20.418401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:20.418823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] PATH_INFO: `/v3/users/1f2c0fc427d84b978de9c89b4586b336` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:20.428488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:20.434085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d92ac9-b70d-4f3e-9ed9-e0efa0fc5a8f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:20.447044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] RBAC: Authorizing `identity:get_user(user_id=1f2c0fc427d84b978de9c89b4586b336)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:20.448475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:20.452442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 53/104] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:20 2022] GET /identity/v3/users/1f2c0fc427d84b978de9c89b4586b336 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:20.458020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:20.501028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:20.501671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:20.501954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:20.502231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:20.503387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:20.504845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:20.506560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 52/105] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:20.511852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:20.628143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a28c40-bc7d-402a-8886-f2b450bcbd3a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:20.666938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014360b-8ca1-426d-badc-1d0d3bfe5069 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:20.718724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:20.719262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:20.719540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:20.719816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:20.720493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:20.721927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:20.726010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e51c4-d25d-452f-ae76-897f3e98cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:20.726651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e51c4-d25d-452f-ae76-897f3e98cd85 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:20.726936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e51c4-d25d-452f-ae76-897f3e98cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:20.727215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e51c4-d25d-452f-ae76-897f3e98cd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:20.817557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:20.838781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 53/106] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:46:20 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:46:20.846114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e51c4-d25d-452f-ae76-897f3e98cd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:20.847655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e51c4-d25d-452f-ae76-897f3e98cd85 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:20.983616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 54/107] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:46:20.988778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:21.015704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:21.105548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19553-d54e-4efd-a437-b08aad5c9b93 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.106012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19553-d54e-4efd-a437-b08aad5c9b93 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.106391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19553-d54e-4efd-a437-b08aad5c9b93 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.109331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 55/108] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:21.117701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa465f-0796-41c1-89ac-bdd424f40607 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.118106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa465f-0796-41c1-89ac-bdd424f40607 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.118483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa465f-0796-41c1-89ac-bdd424f40607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.136814 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0f328-db67-4c86-a068-c3970d4c365c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:21.146678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b4aa465f-0796-41c1-89ac-bdd424f40607 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:21.148283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b4aa465f-0796-41c1-89ac-bdd424f40607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:21.189765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:21.190426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.190710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.190989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.197039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:21.198537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:21.200405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 54/109] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:20 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:21.208067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:21.300060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 56/110] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:21.328710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:21.354825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d28aa-38fe-4c52-b785-5c3047421e76 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:21.396373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:21.396979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.397257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.397530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.398245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] RBAC: Adding query filter params (role.id=a7573ebc103d4a8898b99f1479793866, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=1f2c0fc427d84b978de9c89b4586b336) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:21.398550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:21.399971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b891024-d6ba-43c0-b32d-3d6d07b1fff5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:21.405989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 55/111] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:21 2022] GET /identity/v3/role_assignments?user.id=1f2c0fc427d84b978de9c89b4586b336&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=a7573ebc103d4a8898b99f1479793866 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:21.582826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b73f7-f996-4662-b14d-6fa29b6458ed None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.583482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b73f7-f996-4662-b14d-6fa29b6458ed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.583965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b73f7-f996-4662-b14d-6fa29b6458ed None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.585656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 57/112] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:21.593072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.594029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.594498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.621398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:21.624554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:21.672445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b73f7-f996-4662-b14d-6fa29b6458ed None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:21.692800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:21.733287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 56/113] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:21.832614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b73f7-f996-4662-b14d-6fa29b6458ed None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:21.881928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:21.882575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:21.882857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:21.883136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:21.894538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:21.899523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:21.900430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:21.901200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 58/114] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:21.907143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.006681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:22.036285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb47f5f-1405-42a1-a4aa-c485678b7f82 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:22.086873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:22.087510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.087791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.088069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.088802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:22.089110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:22.090620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55692664-75ec-4eae-880f-613abce98cb3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:22.104859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 57/115] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:22.111156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.200340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:22.203871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c368f-d67a-48d6-99ec-aff47d2db33a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.204153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c368f-d67a-48d6-99ec-aff47d2db33a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.204490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c368f-d67a-48d6-99ec-aff47d2db33a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.205867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 58/116] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:22.211979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.212264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.213068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.243789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:22.245021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:22.267546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c758d-f4bd-40af-a5e5-d72afd2e8723 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:22.314641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:22.315283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.315563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.315839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.317145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:22.318658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:22.320248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 59/117] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:22 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:22.321039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.370368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 59/118] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 15 10:46:22.371245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.477493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:22.493066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecedf6-f15d-4d17-b1f7-cb71e7190c85 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:22.522248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c602c-ea2a-4d57-beeb-fbdd9cfa170c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:22.568924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:22.569581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.569864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.570141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.579605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:22.595398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:22.601543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc796858-dc16-4926-9da9-3a6cf1718306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:22.602258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796858-dc16-4926-9da9-3a6cf1718306 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.602529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796858-dc16-4926-9da9-3a6cf1718306 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.602860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc796858-dc16-4926-9da9-3a6cf1718306 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.605053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796858-dc16-4926-9da9-3a6cf1718306 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:22.606486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc796858-dc16-4926-9da9-3a6cf1718306 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:22.608811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 60/119] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:22 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:22.609871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:22.610703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:22.611471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 60/120] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:22.612100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab929-674b-4125-b134-c180b26d6a65 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.612100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab929-674b-4125-b134-c180b26d6a65 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.612214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab929-674b-4125-b134-c180b26d6a65 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.613426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 61/121] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:22.621246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab929-674b-4125-b134-c180b26d6a65 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.621459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.786687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eeb2a7-aaa4-4b59-a519-8cdd6baf46da None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:22.787779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab929-674b-4125-b134-c180b26d6a65 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:22.825022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:22.826234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.826905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.826905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/0c82e614439e49fc961d933b5aa45282/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.828950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] RBAC: Authorizing `identity:create_grant(project_id=46954ca73fa842eeb4c3abc44e35f9fe, user_id=0c82e614439e49fc961d933b5aa45282, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:22.830493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:22.833174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:22.833837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.834127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.834407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.835075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:22.835380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:22.836796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f654999-7db3-41bb-9cae-34887db6187f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:22.838167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:22.846088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 62/122] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:22.847216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:22.847505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:22.847784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:22.865667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:22.866846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:22.897956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 61/123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:22 2022] PUT /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/0c82e614439e49fc961d933b5aa45282/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:22.900055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.958006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 63/124] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:22.958712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:22.998789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:23.091032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bf970-b5ab-4ff3-9929-8b5ad8292d23 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.147533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.148181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.148495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.148776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.170541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:23.175432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:23.176263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:23.177093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 62/125] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:23.187348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:23.234243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e09c9-0244-4666-b98f-a3fdc4a99bdf None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.283126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:23.300451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.301104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.301386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.301664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.303538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:23.305253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:23.307002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 64/126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:22 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:23.313262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:23.369664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d3284-a817-4e7b-b861-e19a4dbc0670 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.393843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:23.441919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.442540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.442823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.443099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.443854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:23.444071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:23.445488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:23.457176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341e4b2-4d57-4606-be22-ee515be1207b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.467658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 63/127] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:23.472441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:23.501131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.502308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.502778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.503240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.504600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:23.506304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:23.508553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 65/128] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:23 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:23.509578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:23.628755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:23.655426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aba05-70b6-4c76-8e11-54f16527173d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.665170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d05ba-d8b7-4594-a97e-9915fc970ad0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.704735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.705724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.706195 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.706657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.708150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:23.709864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:23.711854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 66/129] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:23 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:23.717226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:23.742993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.743650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.743931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.744210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.777280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:23.783429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:23.784337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:23.785120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 64/130] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:23.785746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:23.844713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:23.886872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc872b16-5058-4c60-8cc5-b9fbccf4ee36 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.937969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957e8d-8c40-4b2e-b591-88639bd06b0e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:23.943263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:23.953680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.959531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.959531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.959531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/3ee61658b90f47ef8962c8e9a5f6c521/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.959531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] RBAC: Authorizing `identity:create_grant(project_id=46954ca73fa842eeb4c3abc44e35f9fe, user_id=3ee61658b90f47ef8962c8e9a5f6c521, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:23.959531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:23.991170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:23.991905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:23.992246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:23.992563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] PATH_INFO: `/v3/projects/58ce6f0785054b41833335e927aead7a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:23.993940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] RBAC: Authorizing `identity:get_project(project_id=58ce6f0785054b41833335e927aead7a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:23.995491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:23.997400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 65/131] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:23 2022] GET /identity/v3/projects/58ce6f0785054b41833335e927aead7a => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:23.998787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:24.073227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 67/132] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:23 2022] PUT /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/3ee61658b90f47ef8962c8e9a5f6c521/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:24.079096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:24.144419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fa2ac-bb16-4f85-b344-d8e97baaf976 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:24.157685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:24.213863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:24.214548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.214834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.215175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.215919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:24.216234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:24.218259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223336d-6a24-4988-ba17-44ee008b4916 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:24.227415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 66/133] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:24.228838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8ec0b-d4e7-4632-ae2c-ed48a19d08a4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.229134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8ec0b-d4e7-4632-ae2c-ed48a19d08a4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.229416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8ec0b-d4e7-4632-ae2c-ed48a19d08a4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.230648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 67/134] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:24.231664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f603f-614a-407e-8995-79ad1a2a5620 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.232080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f603f-614a-407e-8995-79ad1a2a5620 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.232983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f603f-614a-407e-8995-79ad1a2a5620 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.234229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 68/135] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:24.237234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f603f-614a-407e-8995-79ad1a2a5620 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:24.267945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ca71e-f4f7-4a5d-8d67-2ba77078200c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:24.312555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa980-1b4d-4259-b515-27aba74643e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:24.313265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa980-1b4d-4259-b515-27aba74643e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.313549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa980-1b4d-4259-b515-27aba74643e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.313826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa980-1b4d-4259-b515-27aba74643e1 None admin] PATH_INFO: `/v3/projects/58ce6f0785054b41833335e927aead7a/users/0c82e614439e49fc961d933b5aa45282/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.316362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa980-1b4d-4259-b515-27aba74643e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=58ce6f0785054b41833335e927aead7a, user_id=0c82e614439e49fc961d933b5aa45282, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:24.317972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa980-1b4d-4259-b515-27aba74643e1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:24.362671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f603f-614a-407e-8995-79ad1a2a5620 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:24.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788aba11-78cb-4eff-bd14-14787306fc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:24.402917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 68/136] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:24 2022] PUT /identity/v3/projects/58ce6f0785054b41833335e927aead7a/users/0c82e614439e49fc961d933b5aa45282/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:24.403916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aba11-78cb-4eff-bd14-14787306fc35 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.404149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.404949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aba11-78cb-4eff-bd14-14787306fc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.405512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aba11-78cb-4eff-bd14-14787306fc35 None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.412928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.413374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.414080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788aba11-78cb-4eff-bd14-14787306fc35 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:24.415872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788aba11-78cb-4eff-bd14-14787306fc35 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:24.418351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 69/137] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:24 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:24.420813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.421873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.422408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.452457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:24.453265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:24.454335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:24.454466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:24.494150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:24.547572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 70/138] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:24.548793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:24.570145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:24.618326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 69/139] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:24.672934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a1f7e-6bae-4e75-81dd-ece4b57bfec2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:24.712931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:24.713956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.714476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.715030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.717240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:24.719150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:24.721138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 71/140] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:24 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:24.729294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:24.874464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6235b5b-4d8b-434d-b553-122f146faa45 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:24.909566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:24.910295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:24.910575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:24.910855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/0c82e614439e49fc961d933b5aa45282/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:24.913063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] RBAC: Authorizing `identity:create_grant(project_id=46954ca73fa842eeb4c3abc44e35f9fe, user_id=0c82e614439e49fc961d933b5aa45282, role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:24.914494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:24.992247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 70/141] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:24 2022] PUT /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/0c82e614439e49fc961d933b5aa45282/roles/9efddb790ba641d59d0f165b116e2876 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:24.994592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:25.038580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:25.041058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:25.126381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:25.136567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0dc01-9095-4c64-99d6-83b13934e180 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:25.180503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:25.181696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:25.182202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:25.182671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:25.184016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:25.187550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:25.189930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 72/142] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:25.195591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:25.263923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f7d3-3a08-4348-84b7-2b644b0e834f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:25.329957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:25.330605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:25.330879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:25.331142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:25.345443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:25.348283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009943-a051-4bb2-827e-02123828e614 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:25.350031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:25.350265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:25.351124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:25.351893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 71/143] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:25.360764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:25.395216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:25.396287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:25.396821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:25.397350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:25.398255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:25.400034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:25.494654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 73/144] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:25 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:25.495533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:25.500321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe369c-b151-46ad-94a8-7dfdc107c032 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:25.545465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:25.546522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:25.546997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:25.547470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:25.548441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:25.548949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:25.550595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:25.564568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 72/145] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:25.570514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:25.750517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5a4f7-1ccc-46c9-ada6-145462a107ed None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:25.813764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:25.814834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:25.815381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:25.815860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] PATH_INFO: `/v3/users/1f2c0fc427d84b978de9c89b4586b336` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:25.818036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] RBAC: Authorizing `identity:get_user(user_id=1f2c0fc427d84b978de9c89b4586b336)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:25.819779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:25.822049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 74/146] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:25 2022] GET /identity/v3/users/1f2c0fc427d84b978de9c89b4586b336 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:25.828052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:25.966001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d7540-e3df-4ea3-838d-b4d52faedfe0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:26.008556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e1f6d-f486-4e11-93d2-a68e7b4092ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:26.009201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1f6d-f486-4e11-93d2-a68e7b4092ac None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:26.009486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1f6d-f486-4e11-93d2-a68e7b4092ac None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:26.009766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1f6d-f486-4e11-93d2-a68e7b4092ac None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:26.010909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e1f6d-f486-4e11-93d2-a68e7b4092ac None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:26.012370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e1f6d-f486-4e11-93d2-a68e7b4092ac None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:26.014660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 73/147] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:25 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:26.020691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:26.043423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f84c-3f5e-4f3a-8fb5-a0878f471f4f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:26.043712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f84c-3f5e-4f3a-8fb5-a0878f471f4f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:26.044001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f84c-3f5e-4f3a-8fb5-a0878f471f4f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:26.045479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 74/148] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:26.051349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176686f8-0055-4909-83fc-b842e327317d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:26.051603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176686f8-0055-4909-83fc-b842e327317d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:26.051882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176686f8-0055-4909-83fc-b842e327317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:26.070876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:26.092007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-176686f8-0055-4909-83fc-b842e327317d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:26.093328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-176686f8-0055-4909-83fc-b842e327317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:26.148881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:26.219926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b9c8c-99a0-4e42-ae34-78f0a5d1d290 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:26.223780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 75/149] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:26.279626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:26.280012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:26.280288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:26.280626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/1f2c0fc427d84b978de9c89b4586b336/roles/a7573ebc103d4a8898b99f1479793866` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:26.285467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] RBAC: Authorizing `identity:create_grant(project_id=46954ca73fa842eeb4c3abc44e35f9fe, user_id=1f2c0fc427d84b978de9c89b4586b336, role_id=a7573ebc103d4a8898b99f1479793866)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:26.287006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:26.369319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:26 2022] PUT /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/users/1f2c0fc427d84b978de9c89b4586b336/roles/a7573ebc103d4a8898b99f1479793866 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:26.753147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176686f8-0055-4909-83fc-b842e327317d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:26.874519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176686f8-0055-4909-83fc-b842e327317d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:26.915362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:26.916011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:26.916290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:26.916758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:26.933471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:26.939069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:26.939945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:26.940750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 76/151] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:46:26.946496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:27.061996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:27.083444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5596c-70d9-4885-8f35-d476b28d0804 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:27.126994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:27.127609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.127909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.128174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.128912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:27.129220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:27.130607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dc270-3ac7-4cae-919b-7301be779dd0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:27.150577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 76/152] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:27.157177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:27.173465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3977a6-c9e0-4608-8fb0-a60e8848fcf8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.173772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3977a6-c9e0-4608-8fb0-a60e8848fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.174027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3977a6-c9e0-4608-8fb0-a60e8848fcf8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.175514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 77/153] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:27.181683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.181976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.182263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.196451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:27.228876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:27.230075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:27.323447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3841d4-f501-4a82-b0cb-99cf48ff86c5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:27.367873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:27.368553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.368835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.369126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.370272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:27.371722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:27.373941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 77/154] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:27 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:27.380545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:27.393809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 78/155] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:27.493493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:27.502613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb1ba2-2043-4a35-a606-e0e6f785d000 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:27.547734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbbeb-1a63-4fe6-8df3-435e4e556f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:27.548378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbbeb-1a63-4fe6-8df3-435e4e556f21 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.548722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbbeb-1a63-4fe6-8df3-435e4e556f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.549003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbbeb-1a63-4fe6-8df3-435e4e556f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.629419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbbeb-1a63-4fe6-8df3-435e4e556f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:27.630897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbbeb-1a63-4fe6-8df3-435e4e556f21 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:27.742906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:27.764282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 78/156] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:27.770556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:27.867033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0183-86e3-421d-b07a-23dd83241cb4 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.867930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0183-86e3-421d-b07a-23dd83241cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.868899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0183-86e3-421d-b07a-23dd83241cb4 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.871007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 79/157] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:27.878992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:27.880360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:27.880841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:27.907880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:27.913550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:27.915018 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:27.946640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be99c-2906-4883-bff2-cddd13cdcc89 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:28.043212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 80/158] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:28.043868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:28.044136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:28.045147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:28.045381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:28.045620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:28.049535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:28.051025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:28.053150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 79/159] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:27 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:28.065395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:28.202964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd594e7c-1120-4dd4-bfd4-084d0079ee69 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:28.240728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:28.254453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:28.261538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:28.261538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:28.261538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:28.267417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:28.272529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:28.273427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:28.274299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 81/160] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:28.285576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:28.402257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17c58-e33f-4879-bdea-7a12f2919d50 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:28.427622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819ead-eb0c-4621-a007-297b8471d9ae None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:28.477134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:28.477672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:28.477951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:28.478224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:28.478895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:28.479199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:28.480593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:28.492292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 82/161] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:28.493013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:28.493691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:28.493977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:28.494249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:28.494977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=0c82e614439e49fc961d933b5aa45282) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:28.495284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:28.496838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:28.498313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:28.503846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 80/162] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:28 2022] GET /identity/v3/role_assignments?user.id=0c82e614439e49fc961d933b5aa45282&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=35a5b624e6db4cad87cd57e909000815 => generated 608 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:28.548663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:28.614075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a54891-9adb-4532-93eb-3f0e6f145c53 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:28.659400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:28.660050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:28.660346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:28.660632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] PATH_INFO: `/v3/users/3ee61658b90f47ef8962c8e9a5f6c521` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:28.661785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] RBAC: Authorizing `identity:get_user(user_id=3ee61658b90f47ef8962c8e9a5f6c521)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:28.663217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:28.665006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 83/163] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:28 2022] GET /identity/v3/users/3ee61658b90f47ef8962c8e9a5f6c521 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:28.673504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:28.697692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:28.837639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:28.840150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59c7f-9de0-4c20-ae0b-c600815aad10 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:28.906401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51514c7-3948-4e01-b237-80b3b5147eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:28.907035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51514c7-3948-4e01-b237-80b3b5147eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:28.907314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51514c7-3948-4e01-b237-80b3b5147eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:28.907585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51514c7-3948-4e01-b237-80b3b5147eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.029016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51514c7-3948-4e01-b237-80b3b5147eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:29.029571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51514c7-3948-4e01-b237-80b3b5147eb8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:29.057837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:29.102606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673432eb-1b1b-4f05-aa94-1bae5814c331 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:29.123128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:29.199538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:29.200213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.200513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.200989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.233539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:29.235419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 81/164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:29.238965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:29.239902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:29.241118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:29.241737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512f84e-05e2-4e91-b79b-528eb5e9972a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.241804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 84/165] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:29.241866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512f84e-05e2-4e91-b79b-528eb5e9972a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.241866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512f84e-05e2-4e91-b79b-528eb5e9972a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.242770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 82/166] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:29.245466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:29.247410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512f84e-05e2-4e91-b79b-528eb5e9972a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:29.461926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512f84e-05e2-4e91-b79b-528eb5e9972a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:29.468096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dc067-b349-497d-ad8b-460bc6d8dd61 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:29.488728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:29.547292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f418f4-f7d2-4d7e-a2a1-f6fdef841d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:29.547936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f418f4-f7d2-4d7e-a2a1-f6fdef841d4d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.548213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f418f4-f7d2-4d7e-a2a1-f6fdef841d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.548517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f418f4-f7d2-4d7e-a2a1-f6fdef841d4d None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.549618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f418f4-f7d2-4d7e-a2a1-f6fdef841d4d None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:29.551055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f418f4-f7d2-4d7e-a2a1-f6fdef841d4d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:29.552861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 85/167] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:29 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:29.556953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:29.557378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.557564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.557747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.557859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.558024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.558127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.558737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:29.559036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:29.561062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:29.580089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 83/168] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:29.580794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:29.595354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:29.596599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:29.672193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:29.757044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 86/169] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:29.760331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:29.781705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799d0dd-af08-482e-925e-900bf1549e9d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:29.835792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:29.836825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.837362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.837889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.838882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=3ee61658b90f47ef8962c8e9a5f6c521) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:29.839385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:29.841077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a29d-39f6-4ca6-9f17-716514523e96 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:29.852338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 84/170] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:29 2022] GET /identity/v3/role_assignments?user.id=3ee61658b90f47ef8962c8e9a5f6c521&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:29.964776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124549d9-68e4-461a-b173-b6bac83cd265 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:29.980150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9aa1d-7ae1-4a2c-92af-162222e94acd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.980501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9aa1d-7ae1-4a2c-92af-162222e94acd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.980794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9aa1d-7ae1-4a2c-92af-162222e94acd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:29.982486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 85/171] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:29.994201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:29.994472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:29.994727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.014473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:30.015021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.015295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.015565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.018886 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:30.020346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:30.021962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 87/172] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:29 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:30.031513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.045506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:30.046774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:30.115679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:30.118251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:30.221823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 86/173] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:30.223049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.264903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51484e5-0195-4caf-91f9-60d66dd7be42 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:30.337171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:30.338176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.338667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.339128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.430085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:30.431877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:30.438506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f27b4-6445-403a-918a-a0f9d174ed8f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:30.469695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:30.503433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:30.504118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.504629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.504629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.518689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:30.523470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:30.524403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:30.525291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:30.527672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 87/174] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:30.535355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.554614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 88/175] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:46:30.561431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.572797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:30.682959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bac36-619f-4e0c-b2f1-755e3d58d03b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:30.690930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831861a-b19f-4a14-95c3-fa1725da801d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:30.725134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f3fd4-a268-4a3e-9fe2-a819a28865a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:30.726145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f3fd4-a268-4a3e-9fe2-a819a28865a7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.726624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f3fd4-a268-4a3e-9fe2-a819a28865a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.727205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f3fd4-a268-4a3e-9fe2-a819a28865a7 None admin] PATH_INFO: `/v3/projects/58ce6f0785054b41833335e927aead7a` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.728541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f3fd4-a268-4a3e-9fe2-a819a28865a7 None admin] RBAC: Authorizing `identity:get_project(project_id=58ce6f0785054b41833335e927aead7a)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:30.730136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f3fd4-a268-4a3e-9fe2-a819a28865a7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:30.732265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 89/176] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/projects/58ce6f0785054b41833335e927aead7a => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:30.733769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f424f81-8948-48fb-ba27-f31eaeded5da None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.734190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f424f81-8948-48fb-ba27-f31eaeded5da None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.734600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f424f81-8948-48fb-ba27-f31eaeded5da None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.735944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 90/177] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:30.741308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f424f81-8948-48fb-ba27-f31eaeded5da None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.745093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:30.762082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:30.762697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.762972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.774050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.774050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:30.774050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:30.774050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468d3a-102b-4002-b7f1-a16d1d2c7f42 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:30.787850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 88/178] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:30.789151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.789440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.789717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.815433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:30.816656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:30.859359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f424f81-8948-48fb-ba27-f31eaeded5da None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:30.900517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:30.901224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:30.901607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:30.901942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:30.902738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=58ce6f0785054b41833335e927aead7a, user.id=0c82e614439e49fc961d933b5aa45282) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:30.903109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:30.905433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:30.911710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 89/179] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:30.911710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.917339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 91/180] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/role_assignments?user.id=0c82e614439e49fc961d933b5aa45282&scope.project.id=58ce6f0785054b41833335e927aead7a&role.id=35a5b624e6db4cad87cd57e909000815 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:30.918013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:30.948341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.053603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.102094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ee788-ce33-49f4-a08c-9577f27e2028 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.120769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4128-dca2-4491-99d7-9115900c934a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.191352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.192008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.192283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.192577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] PATH_INFO: `/v3/users/0c82e614439e49fc961d933b5aa45282` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.197021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] RBAC: Authorizing `identity:get_user(user_id=0c82e614439e49fc961d933b5aa45282)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:31.198498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:31.200277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 90/181] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/users/0c82e614439e49fc961d933b5aa45282 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:31.202209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.202864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.203145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.203422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.206142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.234998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:31.240959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:31.241866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:31.242643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 92/182] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:31.249250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.332529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.349237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d58b4-742b-4e79-94ed-ee81b0e2693d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.383121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7024e6a-2e8c-43a7-8904-e15e872e2417 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.386367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.386931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.387213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.387489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.413928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.422706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.426207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.426207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.426207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.426207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:31.426207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:31.426207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c96c5-e1d6-4ea6-a833-4c328e9b1a2c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:31.434628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 93/183] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:31.436678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6542-ed79-4786-b75a-4b0c8a7fef1b None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.437139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6542-ed79-4786-b75a-4b0c8a7fef1b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.437776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6542-ed79-4786-b75a-4b0c8a7fef1b None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.439367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 94/184] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:31.443928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a679c-b8d2-4796-8824-c3467c8ab646 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.443928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a679c-b8d2-4796-8824-c3467c8ab646 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.443928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a679c-b8d2-4796-8824-c3467c8ab646 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.443928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 95/185] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:31.447246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a679c-b8d2-4796-8824-c3467c8ab646 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.459409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:31.460909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:31.547737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a679c-b8d2-4796-8824-c3467c8ab646 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.548464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.564003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 91/186] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:46:31.564702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.586343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de32a-401f-4794-85ac-f5a4bed185a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.586897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de32a-401f-4794-85ac-f5a4bed185a2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.587180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de32a-401f-4794-85ac-f5a4bed185a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.587453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de32a-401f-4794-85ac-f5a4bed185a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.597762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de32a-401f-4794-85ac-f5a4bed185a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-0c0de32a-401f-4794-85ac-f5a4bed185a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:31.602518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:31.603425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:31.604236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 96/187] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:31.605512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2d0a-66da-4874-8e67-35e5ca900619 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.605512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2d0a-66da-4874-8e67-35e5ca900619 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.605684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2d0a-66da-4874-8e67-35e5ca900619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.623310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-118f2d0a-66da-4874-8e67-35e5ca900619 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:31.624515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-118f2d0a-66da-4874-8e67-35e5ca900619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:31.665996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d8ed2-8029-46d4-838b-5978b775b3b9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.667588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.690572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 97/188] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:31.691618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.691907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.692193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.699642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.700262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.701443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.701659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] PATH_INFO: `/v3/users/1f2c0fc427d84b978de9c89b4586b336` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.702976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=1f2c0fc427d84b978de9c89b4586b336)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:31.704435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:31.705990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 92/189] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/users/1f2c0fc427d84b978de9c89b4586b336 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:31.706741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.715667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:31.717561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:31.765640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.792659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 98/190] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:31.793828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.835398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796096e-1fb1-4ab9-b8ac-e3f1590dc9d6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.874881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.875518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.875795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.876066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.877222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:31.878655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:31.880549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 93/191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:31.881314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:31.939344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2da7-7677-4154-b1e6-6572005c46ab None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:31.949334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:31.980367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:31.980984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:31.981263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:31.981588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:31.983388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:31.983695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:31.985768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:31.994852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 99/192] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:31.995639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.003017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbd8cf-cf74-41f9-a469-96bcfe513d78 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.036483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.042584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.043303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.043576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.043853 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.110561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a3017-819e-4c4e-89b3-afdbce09eb5c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.116009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.117547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.143725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.144245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.144555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.144835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.145558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] RBAC: Adding query filter params (role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=0c82e614439e49fc961d933b5aa45282) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:32.145869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.147293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.152943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 100/193] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/role_assignments?user.id=0c82e614439e49fc961d933b5aa45282&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=9efddb790ba641d59d0f165b116e2876 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:32.154406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.196488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.227380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 94/194] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:32.228240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.254791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.273224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5251f-9a97-4428-a6f8-2ef61383ebd8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.312651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.313305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.313586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.313861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.315027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.316529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.318185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 101/195] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:32.323734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.345198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1ae93-1d54-4054-9b11-68da0b08930f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.382990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.383625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.383906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.384183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] PATH_INFO: `/v3/users/5bf804d9b71f4313929e6c12e215ee26` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.404981 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] RBAC: Authorizing `identity:get_user(user_id=5bf804d9b71f4313929e6c12e215ee26)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.406381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.408075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 95/196] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/users/5bf804d9b71f4313929e6c12e215ee26 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:32.408986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.437666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24701a4-366e-474b-a812-3a50f146a7b2 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.439204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.471474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.472103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.472412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.472689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.482964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:32.488174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:32.489185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:32.489973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 102/197] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:32.490913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.491318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.510182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3d16-49b8-43d7-a536-7af9388fe67f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.543572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.544202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.545002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.545274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.546377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.547821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.549494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 96/198] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:32.550243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.601358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78e80c-3bdc-4041-8a0c-c6011fe95316 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.634908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.635521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.635809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.636080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.636767 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.638201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.650793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a6aee-7704-4649-be34-a9ddec4629e8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.683948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.684585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.684869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.685703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.702698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.739118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 103/199] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:32 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:32.752711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.754364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.756051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.776973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.868251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad425b-8afe-4bae-a334-41a3d4999eda None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:32.873860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 97/200] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:32.873860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.910752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:32.911373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:32.911651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:32.912302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:32.912647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:32.912954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:32.914335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:32.922788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 104/201] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:32.923600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:32.933724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:32.995144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26686c4-ccac-45b6-bd5e-01b32b164d19 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.023599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:33.038196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.045901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.045901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.045901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.045901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] RBAC: Adding query filter params (role.id=a7573ebc103d4a8898b99f1479793866, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe, user.id=1f2c0fc427d84b978de9c89b4586b336) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:33.045901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.045901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.052267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 98/202] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/role_assignments?user.id=1f2c0fc427d84b978de9c89b4586b336&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=a7573ebc103d4a8898b99f1479793866 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:33.055098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9140-b2f0-42a1-8876-9ea9660650e6 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.055288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:33.099758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.100847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.101334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.101958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.103549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.105282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.107264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 105/203] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:32 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:33.113336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:33.195492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375565ba-ac9e-49f0-a1ed-c20b855b219b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.217623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:33.242911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.243560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.243839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.244114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] PATH_INFO: `/v3/users/5bf804d9b71f4313929e6c12e215ee26` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.249814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] RBAC: Authorizing `identity:get_user(user_id=5bf804d9b71f4313929e6c12e215ee26)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.249814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.249814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 99/204] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:33 2022] GET /identity/v3/users/5bf804d9b71f4313929e6c12e215ee26 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:33.256052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:33.290271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf9b2f-37ff-4a15-a2af-782c6ba42ef9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.338915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.339943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.340234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.340744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.341829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=5bf804d9b71f4313929e6c12e215ee26) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:33.342303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.344017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.352194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 106/205] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:33 2022] GET /identity/v3/role_assignments?user.id=5bf804d9b71f4313929e6c12e215ee26&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:33.392671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496435f4-7b0a-40a2-bd01-c92b93fba0ca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.435300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.436293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.436800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.437290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.498689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:33.525548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.527654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.646610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 100/206] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:46:33.652169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:33.670990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:33.759780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc47c5d-eb93-4de0-9973-c6f3bdefa464 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.797977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354f041-a7ee-4a04-a05c-3dada92e3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.798541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f041-a7ee-4a04-a05c-3dada92e3df7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.798820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f041-a7ee-4a04-a05c-3dada92e3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.799864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354f041-a7ee-4a04-a05c-3dada92e3df7 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.800528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354f041-a7ee-4a04-a05c-3dada92e3df7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.803550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354f041-a7ee-4a04-a05c-3dada92e3df7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.805218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 107/207] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:33 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:33.812859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:33.928679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:33.946775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05067f-c20f-423e-9d5b-8b59343e18b7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:33.983367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:33.983990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:33.984265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:33.984568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:33.985305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] RBAC: Adding query filter params (role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=5bf804d9b71f4313929e6c12e215ee26) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:33.985611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:33.987069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f1219-2ba1-43e8-aef3-98c09cdeb471 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:33.993734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 101/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:33 2022] GET /identity/v3/role_assignments?user.id=5bf804d9b71f4313929e6c12e215ee26&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=9efddb790ba641d59d0f165b116e2876 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:35.197059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9754963-4715-4fec-8d8d-3f56eaefc1df None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.197648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9754963-4715-4fec-8d8d-3f56eaefc1df None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.197648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9754963-4715-4fec-8d8d-3f56eaefc1df None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.199270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 108/209] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:35.205518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3e23f-6a05-445f-8460-62ad6daffb6f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.206058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3e23f-6a05-445f-8460-62ad6daffb6f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.206058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3e23f-6a05-445f-8460-62ad6daffb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.230015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-01c3e23f-6a05-445f-8460-62ad6daffb6f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:35.231222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-01c3e23f-6a05-445f-8460-62ad6daffb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:35.301403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 102/210] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:35.322758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b801fb-168a-4fe0-b153-d0e9c07c287a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.323370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b801fb-168a-4fe0-b153-d0e9c07c287a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.323891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b801fb-168a-4fe0-b153-d0e9c07c287a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.328579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 109/211] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:35.331624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e98c-353e-4376-b4c8-653ef141aacf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.331914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e98c-353e-4376-b4c8-653ef141aacf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.332194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e98c-353e-4376-b4c8-653ef141aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.351079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9630e98c-353e-4376-b4c8-653ef141aacf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:35.352236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9630e98c-353e-4376-b4c8-653ef141aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:35.421020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 103/212] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:35.576383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b801fb-168a-4fe0-b153-d0e9c07c287a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:35.666312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:35.667315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ffa44-d135-45ee-876b-e424409a714e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.667560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ffa44-d135-45ee-876b-e424409a714e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.667846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ffa44-d135-45ee-876b-e424409a714e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.669771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 104/213] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:35.675335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.675620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.681619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.689944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:35.690998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b801fb-168a-4fe0-b153-d0e9c07c287a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:35.701688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:35.703247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:35.731313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:35.732590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.732911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.733180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.743899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:35.749588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:35.750523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:35.751355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 110/214] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:35.752051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:35.793265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 105/215] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:35.793265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:35.876133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f8906-aa22-45a8-9f22-a65684d0c91d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:35.924288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:35.924966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.925248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.925524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.925803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e40c1-7c65-4c2c-bcdf-b6bd195fae5e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:35.926646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:35.928977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:35.930772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 111/216] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:35.936156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:35.948557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:35.979783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:35.980791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:35.981564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:35.982751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:35.983926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:35.984727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:35.986417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:35.988628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:35.998340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 106/217] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:36.005443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.057134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f0b7-2db8-41db-8d71-9c880ac76ce4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.095608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.096558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.096978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.097410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.098208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.099787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.148859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fe43-fd4e-4572-8588-b50eaebe8b88 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.185929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c830a1d-6a9d-42e0-96bb-8ccb5d38617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.186552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830a1d-6a9d-42e0-96bb-8ccb5d38617e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.186856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830a1d-6a9d-42e0-96bb-8ccb5d38617e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.187127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c830a1d-6a9d-42e0-96bb-8ccb5d38617e None admin] PATH_INFO: `/v3/users/a5d1ed1b4c844399bcb1156f548ffc18` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.196905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 112/218] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:35 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:36.199302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.204135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830a1d-6a9d-42e0-96bb-8ccb5d38617e None admin] RBAC: Authorizing `identity:get_user(user_id=a5d1ed1b4c844399bcb1156f548ffc18)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.205720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c830a1d-6a9d-42e0-96bb-8ccb5d38617e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.207466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 107/219] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/users/a5d1ed1b4c844399bcb1156f548ffc18 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:36.208869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99330fd-e9a9-43b1-abbb-b17c7eabffee None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.209155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99330fd-e9a9-43b1-abbb-b17c7eabffee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.209430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99330fd-e9a9-43b1-abbb-b17c7eabffee None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.211120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 108/220] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:36.213362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99330fd-e9a9-43b1-abbb-b17c7eabffee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.283543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:36.285485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:36.327997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac09173-cc91-49f4-aa04-a5e6ae506d64 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.332219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99330fd-e9a9-43b1-abbb-b17c7eabffee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.365637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4a002-af7c-4ac2-96a6-e6dafcb0178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.366381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a002-af7c-4ac2-96a6-e6dafcb0178f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.366580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a002-af7c-4ac2-96a6-e6dafcb0178f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.366819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4a002-af7c-4ac2-96a6-e6dafcb0178f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.371296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.371911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.372190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.372675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.379066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4a002-af7c-4ac2-96a6-e6dafcb0178f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-2bf4a002-af7c-4ac2-96a6-e6dafcb0178f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:36.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:36.385413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:36.386199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 113/221] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:36.387351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.387351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.387514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.407049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:36.408157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:36.449185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.451247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.491949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 114/222] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:36.493211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.519511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:36.562442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:36.580475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 109/223] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:36.586596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.612082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b65c-7823-4466-bf13-de83042d800d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.649403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.650025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.650307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.650708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.651288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:36.651638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.653199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.663544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 115/224] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:36.673370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.704101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153edf4e-6f80-4371-9582-c34436b9c2db None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.743124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.744283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.744773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.745276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.746867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.748696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.751647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 110/225] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:36.758914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.788554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:36.851533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40a855-5df6-4cbb-a385-b6dcd63f7827 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.870821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:36.892934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.893168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887124f8-12a8-4e15-aef3-6163a5b9367f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:36.894075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.894867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.896343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] PATH_INFO: `/v3/users/5bf804d9b71f4313929e6c12e215ee26` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.897780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] RBAC: Authorizing `identity:get_user(user_id=5bf804d9b71f4313929e6c12e215ee26)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.900196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.903059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 116/226] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/users/5bf804d9b71f4313929e6c12e215ee26 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:36.905630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:36.933857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:36.934825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:36.935190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:36.935731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:36.936640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=a5d1ed1b4c844399bcb1156f548ffc18) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:36.936957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:36.938631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:36.946825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 111/227] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/role_assignments?user.id=a5d1ed1b4c844399bcb1156f548ffc18&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=35a5b624e6db4cad87cd57e909000815 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:36.947921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:37.071277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:37.104364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6237b-03c3-45d1-952e-b4fe997e9961 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:37.131686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7a36-15d4-4021-ae1f-5420ce970584 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:37.180952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:37.182010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:37.182339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:37.182621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:37.184105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:37.185939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:37.186938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:37.187607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 112/228] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:37.187915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:37.188222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:37.188530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:37.193651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:37.203142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:37.209712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:37.210646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:37.211437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:37.212049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 117/229] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:37.217639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:37.291572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:37.353401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0801e-a8a0-4637-abe6-bbe5714f72ef None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:37.422060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b43e-ddf2-4d9c-abe7-245e74d5694b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:37.424969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:37.425772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:37.428090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:37.428537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:37.430729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:37.431180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:37.436772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:37.452723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 118/230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:37.458067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:37.503022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:37.504030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:37.504475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:37.504936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/5bf804d9b71f4313929e6c12e215ee26/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:37.508302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2caddf9c1b4ea08235ed5e19f152ac, user_id=5bf804d9b71f4313929e6c12e215ee26, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:37.509947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:37.599740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bd1d5-e690-493b-9226-e0ac62a9fa19 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:37.602616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 113/231] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:37 2022] PUT /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/5bf804d9b71f4313929e6c12e215ee26/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:46:37.607987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:37.644048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:37.644750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:37.645036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:37.645315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] PATH_INFO: `/v3/users/5bf804d9b71f4313929e6c12e215ee26` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:37.646562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] RBAC: Authorizing `identity:get_user(user_id=5bf804d9b71f4313929e6c12e215ee26)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:37.648117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:37.654840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 119/232] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:37 2022] GET /identity/v3/users/5bf804d9b71f4313929e6c12e215ee26 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:37.660867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:37.679478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:37.803802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f3e1-6e22-48f8-8f9c-fb8f2ac849d5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:37.867804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ec9a-5e96-47b2-ac16-8fb5b03fb895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:37.868839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ec9a-5e96-47b2-ac16-8fb5b03fb895 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:37.869344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ec9a-5e96-47b2-ac16-8fb5b03fb895 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:37.869828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ec9a-5e96-47b2-ac16-8fb5b03fb895 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:37.871302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ec9a-5e96-47b2-ac16-8fb5b03fb895 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:37.873145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ec9a-5e96-47b2-ac16-8fb5b03fb895 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:37.875347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 114/233] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:37 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:37.881177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:38.002254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5324be-cfe6-4121-84eb-89973243b021 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:38.065171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1f712-dfc4-4869-b218-25e0f93ab912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:38.066209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1f712-dfc4-4869-b218-25e0f93ab912 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:38.066750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1f712-dfc4-4869-b218-25e0f93ab912 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:38.067233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1f712-dfc4-4869-b218-25e0f93ab912 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/5bf804d9b71f4313929e6c12e215ee26/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:38.074488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1f712-dfc4-4869-b218-25e0f93ab912 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2caddf9c1b4ea08235ed5e19f152ac, user_id=5bf804d9b71f4313929e6c12e215ee26, role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:38.076531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1f712-dfc4-4869-b218-25e0f93ab912 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:38.192483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 120/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:37 2022] PUT /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/5bf804d9b71f4313929e6c12e215ee26/roles/9efddb790ba641d59d0f165b116e2876 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:46:38.739728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a930-aa50-4ef4-89b2-7a5235cfd670 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:38.741055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a930-aa50-4ef4-89b2-7a5235cfd670 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:38.741540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30a930-aa50-4ef4-89b2-7a5235cfd670 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:38.743337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 115/235] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:38.749116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:38.749918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:38.750402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:38.774738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:38.777000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:38.813889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:38.872168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 121/236] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:39.334441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce56b8-73a2-4238-a154-ea8c84dd27f9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:39.334784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce56b8-73a2-4238-a154-ea8c84dd27f9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:39.336972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce56b8-73a2-4238-a154-ea8c84dd27f9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:39.339816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 116/237] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:39.348696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:39.348903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:39.348903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:39.349395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:39.389116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:39.392198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:39.539420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9b9b-552f-4188-afa5-ad886d774acb None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:39.576622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 117/238] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:39.598472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7af2-7273-4f1c-b08b-297850605134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:39.599057 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7af2-7273-4f1c-b08b-297850605134 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:39.599338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7af2-7273-4f1c-b08b-297850605134 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:39.599612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7af2-7273-4f1c-b08b-297850605134 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:39.615157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7af2-7273-4f1c-b08b-297850605134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-da5d7af2-7273-4f1c-b08b-297850605134 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:39.620858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:39.621740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:39.623164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:39.625664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 122/239] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:39.631555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:39.657721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:39.763630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949d259-d066-424e-9fb8-50789041293b None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:39.764138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949d259-d066-424e-9fb8-50789041293b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:39.764551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949d259-d066-424e-9fb8-50789041293b None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:39.767114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 123/240] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:39.773634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10678171-e40c-4931-819e-df8278d8b973 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:39.773929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10678171-e40c-4931-819e-df8278d8b973 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:39.775282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10678171-e40c-4931-819e-df8278d8b973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:39.800367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a4c6b-22fb-48fe-8976-1131e6ce11ee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:39.812722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-10678171-e40c-4931-819e-df8278d8b973 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:39.813802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-10678171-e40c-4931-819e-df8278d8b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:39.850669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:39.852396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:39.857978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:39.858275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:39.859107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:39.859418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:39.864589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:39.868560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:39.879070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 118/241] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:39.885794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:39.938428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 124/242] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:39.939308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10678171-e40c-4931-819e-df8278d8b973 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:39.978435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:40.008492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b39f-74c1-4bb6-ba20-6aa6b05996b9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.051305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.052595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.054392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.054693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] PATH_INFO: `/v3/users/7ca19f99f6024d4f947fbbf4118a71a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.088272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] RBAC: Authorizing `identity:get_user(user_id=7ca19f99f6024d4f947fbbf4118a71a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:40.089761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:40.096805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 119/243] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:39 2022] GET /identity/v3/users/7ca19f99f6024d4f947fbbf4118a71a0 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:40.100971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.220178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10678171-e40c-4931-819e-df8278d8b973 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.298682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.299324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.299604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.299880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.301037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:40.302717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:40.305438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 125/244] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:40.306137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.311496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07f12-eeec-4756-9d9b-9d5744f6cb28 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.339711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:40.348267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:40.360487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b159d4-d885-4e5e-a9d0-e63f94560f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.360487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b159d4-d885-4e5e-a9d0-e63f94560f2d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.360487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b159d4-d885-4e5e-a9d0-e63f94560f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.360487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b159d4-d885-4e5e-a9d0-e63f94560f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.437306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaeb1c9-b2fc-411a-9782-858788050c14 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.449529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b159d4-d885-4e5e-a9d0-e63f94560f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:40.451311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b159d4-d885-4e5e-a9d0-e63f94560f2d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:40.476885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.477603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.477951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.478294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.488865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:40.494351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:40.495233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:40.496019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 126/245] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:40.496737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.570892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 120/246] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:40.572550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b5af5-1139-4446-8404-ed26329e6899 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.573061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b5af5-1139-4446-8404-ed26329e6899 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.573537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b5af5-1139-4446-8404-ed26329e6899 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.575240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 121/247] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:40.576906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b5af5-1139-4446-8404-ed26329e6899 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.589158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:40.608237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef831d-fc6d-407c-95d7-6b07940fa2c0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.609174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:40.643375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.643916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.644457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.645176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.645974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:40.647393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:40.684362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b5af5-1139-4446-8404-ed26329e6899 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.706421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 127/248] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:40 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:40.707467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.735441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.737629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.737914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.738190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.738886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:40.739191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:40.741839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa97e0e-a667-4f78-a461-e8c7b0923893 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:40.754615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 122/249] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:40.756355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.756832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.757339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.781647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:40.783541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:40.878724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9238-2dc4-417a-b94f-9d9cc66e19ae None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:40.913768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 123/250] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:40.915168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.924231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:40.924916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:40.925197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:40.925473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:40.926605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:40.928047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:40.930103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 128/251] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:40 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:40.936115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:40.947699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:40.951900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:41.050578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7c08b-4321-4499-8339-5f884486a359 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.080884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7f372-625a-4876-9016-e6030394e217 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.098515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1bec1-f639-4071-8221-70167028aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.099374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1bec1-f639-4071-8221-70167028aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.099793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1bec1-f639-4071-8221-70167028aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.100072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1bec1-f639-4071-8221-70167028aeb7 None admin] PATH_INFO: `/v3/users/a5d1ed1b4c844399bcb1156f548ffc18` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.101225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1bec1-f639-4071-8221-70167028aeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=a5d1ed1b4c844399bcb1156f548ffc18)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:41.102647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1bec1-f639-4071-8221-70167028aeb7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:41.104213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 124/252] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:40 2022] GET /identity/v3/users/a5d1ed1b4c844399bcb1156f548ffc18 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:41.105513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90fc1b-da88-4dc4-88f8-d360aeb2671f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.105840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90fc1b-da88-4dc4-88f8-d360aeb2671f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.106060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90fc1b-da88-4dc4-88f8-d360aeb2671f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.111542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 125/253] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:41.112393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90fc1b-da88-4dc4-88f8-d360aeb2671f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.121262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.121545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.121775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.122058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.123316 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] RBAC: Adding query filter params (role.id=a7573ebc103d4a8898b99f1479793866, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=7ca19f99f6024d4f947fbbf4118a71a0) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:41.123627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:41.125273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31173a2f-8a00-47b6-b9c4-03b574b31ba4 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:41.131412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 129/254] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:40 2022] GET /identity/v3/role_assignments?user.id=7ca19f99f6024d4f947fbbf4118a71a0&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=a7573ebc103d4a8898b99f1479793866 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:41.133378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.133378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.133378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.154284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:41.155493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:41.224903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:41.236555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 130/255] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:41.237599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.255052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:41.276965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90fc1b-da88-4dc4-88f8-d360aeb2671f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.335167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.336366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.336857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.337384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.338927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:41.340838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:41.343235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 126/256] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:41 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:41.347182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c507b0-e046-41a4-8ec1-b2bc88503445 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.349120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.382756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.383394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.383672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.383942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.395654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:41.400469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:41.401349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:41.402130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 131/257] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:41.407590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.469040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:41.510444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59f26b-4c22-460d-b6de-cd5d5d0c2b02 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.556849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.557461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.557735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.558002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.558665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:41.558961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:41.560422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:41.579053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 132/258] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:41.586094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.606382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a442b-dfe0-4b75-a604-53b15a1b8057 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.670678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.671352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.671637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.671914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/a5d1ed1b4c844399bcb1156f548ffc18/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.678037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2caddf9c1b4ea08235ed5e19f152ac, user_id=a5d1ed1b4c844399bcb1156f548ffc18, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:41.679432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:41.741428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce080c-5b6e-44c7-9abe-ae07f56f9b92 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.767373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:41.775253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 127/259] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:41 2022] PUT /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/a5d1ed1b4c844399bcb1156f548ffc18/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:41.776188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.786859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.789001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.789001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.789001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] PATH_INFO: `/v3/users/5bf804d9b71f4313929e6c12e215ee26` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.789217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] RBAC: Authorizing `identity:get_user(user_id=5bf804d9b71f4313929e6c12e215ee26)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:41.790833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:41.792792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 133/260] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:41 2022] GET /identity/v3/users/5bf804d9b71f4313929e6c12e215ee26 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:41.798570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:41.818981 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:41.933624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142b8e-0f4c-471f-89e2-69ae3757c77e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:41.975023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:41.975659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:41.975939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:41.976211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:41.983358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405455-9495-4180-a967-1586754a12f5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:42.048824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:42.054842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:42.056346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:42.117047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:42.117693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:42.117967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:42.118240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:42.165041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:42.166322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 134/261] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:42.174511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:42.175551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:42.176389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:42.177001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:42.177070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 128/262] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:42.185537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:42.306076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:42.312685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:42.334913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1e780-dd9f-4850-b262-a96bf66d6ae7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:42.339642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14acc-4086-46e3-9512-ccfb6b491419 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:42.380346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:42.381795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:42.382255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:42.382728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:42.383570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:42.384052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:42.385934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:42.396744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 129/263] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:42.405406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:42.433940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:42.434586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:42.434964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:42.435360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:42.441020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:42.442468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:42.444568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 135/264] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:42 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:42.450237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:42.610450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43443863-3fb3-4e4c-b497-6b8deb1fba04 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:42.655334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154eeda-f1c8-4e92-9383-8e74a4810f25 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:42.685517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:42.686303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:42.686593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:42.686865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] PATH_INFO: `/v3/users/5bf804d9b71f4313929e6c12e215ee26` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:42.688085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] RBAC: Authorizing `identity:get_user(user_id=5bf804d9b71f4313929e6c12e215ee26)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:42.689601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:42.691480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 130/265] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:42 2022] GET /identity/v3/users/5bf804d9b71f4313929e6c12e215ee26 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:42.697359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:42.702721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:42.703353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:42.703878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:42.704160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:42.704948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=5bf804d9b71f4313929e6c12e215ee26) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:42.705261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:42.707805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:42.717254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 136/266] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:42 2022] GET /identity/v3/role_assignments?user.id=5bf804d9b71f4313929e6c12e215ee26&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:42.720519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:42.819017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17314b-0728-46da-b41b-faf9e55291a7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:42.856803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:42.857430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:42.857716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:42.857996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:42.933042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:42.934451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:42.946818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:43.044991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 131/267] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:46:43.053330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:43.084820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:43.175563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a302-4e20-471b-a4e0-e1d99dfa95a9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:43.212409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb2763-f47b-408e-b0cf-29a65705564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:43.212956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2763-f47b-408e-b0cf-29a65705564f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:43.213240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2763-f47b-408e-b0cf-29a65705564f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:43.213562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2763-f47b-408e-b0cf-29a65705564f None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:43.214724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb2763-f47b-408e-b0cf-29a65705564f None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:43.216215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb2763-f47b-408e-b0cf-29a65705564f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:43.217895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 137/268] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:43 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:43.223777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:43.330274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b2961-51cc-40d0-8176-903575210d34 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:43.342485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:43.369349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:43.370030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:43.370321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:43.370596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:43.371343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] RBAC: Adding query filter params (role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=5bf804d9b71f4313929e6c12e215ee26) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:43.371656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:43.373723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac373f65-8fb3-4690-b606-496a9c2ca681 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:43.380300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 132/269] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:43 2022] GET /identity/v3/role_assignments?user.id=5bf804d9b71f4313929e6c12e215ee26&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=9efddb790ba641d59d0f165b116e2876 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:43.881651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a916b3e-c751-4aa6-89fd-44d9f11d9ec1 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:43.882025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a916b3e-c751-4aa6-89fd-44d9f11d9ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:43.882204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a916b3e-c751-4aa6-89fd-44d9f11d9ec1 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:43.883849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 138/270] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:43.892390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3986f-98d9-47f7-af93-72df0b7dabe3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:43.892737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3986f-98d9-47f7-af93-72df0b7dabe3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:43.893028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3986f-98d9-47f7-af93-72df0b7dabe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:43.912402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4fc3986f-98d9-47f7-af93-72df0b7dabe3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:43.913597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4fc3986f-98d9-47f7-af93-72df0b7dabe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:43.992091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 133/271] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:44.220239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a51b6-f1b0-4fcb-b6e8-85f2890ed015 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.220742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a51b6-f1b0-4fcb-b6e8-85f2890ed015 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.220742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a51b6-f1b0-4fcb-b6e8-85f2890ed015 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.222097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 139/272] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:44.228744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cbf49-de6a-49a7-b8c0-995a3eec5b48 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.229164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cbf49-de6a-49a7-b8c0-995a3eec5b48 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.229334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cbf49-de6a-49a7-b8c0-995a3eec5b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.249278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9c2cbf49-de6a-49a7-b8c0-995a3eec5b48 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:44.250495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9c2cbf49-de6a-49a7-b8c0-995a3eec5b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:44.297501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a51b6-f1b0-4fcb-b6e8-85f2890ed015 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:44.327157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:44.394692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452104d-0615-4c61-9252-7768e00b4fb6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.395026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452104d-0615-4c61-9252-7768e00b4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.395315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452104d-0615-4c61-9252-7768e00b4fb6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.396974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 135/274] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:44.401759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.402045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.402325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.403896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:44.415760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a51b6-f1b0-4fcb-b6e8-85f2890ed015 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:44.426655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:44.428547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:44.455800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:44.456557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.457039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.457522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.463232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:44.471030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:44.477170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:44.480403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:44.481208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 140/275] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:44.484738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:44.516344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 136/276] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:44.598324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324cd94-6b6d-4bcf-bdd8-d182af5182f9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:44.606155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:44.641222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:44.642241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.642736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.643215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.644170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:44.644780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:44.646344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:44.657366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 141/277] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:44.663102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:44.679343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:44.726575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc61127-e0c6-4212-8d2f-336159471872 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:44.763116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394017e-b131-47b4-bd0a-890f9612c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:44.766019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394017e-b131-47b4-bd0a-890f9612c812 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.766019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394017e-b131-47b4-bd0a-890f9612c812 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.766019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394017e-b131-47b4-bd0a-890f9612c812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.766019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394017e-b131-47b4-bd0a-890f9612c812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:44.766913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394017e-b131-47b4-bd0a-890f9612c812 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:44.768727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 137/278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:44.769622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb782-2981-46be-96f3-1654657fbf32 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.769904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb782-2981-46be-96f3-1654657fbf32 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.770336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb782-2981-46be-96f3-1654657fbf32 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.773029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 138/279] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:44.773326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c63fb-bcde-44a9-8429-7e0c35585eb6 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:44.774238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcb782-2981-46be-96f3-1654657fbf32 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:44.809984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:44.810232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c2c66-80a7-4cb3-b911-6cbe5f61ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:44.810824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c2c66-80a7-4cb3-b911-6cbe5f61ba56 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.811098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c2c66-80a7-4cb3-b911-6cbe5f61ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.811369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c2c66-80a7-4cb3-b911-6cbe5f61ba56 None admin] PATH_INFO: `/v3/users/8ebf9ca5451f44179b1ad452e35ac55d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.825035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c2c66-80a7-4cb3-b911-6cbe5f61ba56 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebf9ca5451f44179b1ad452e35ac55d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:44.826561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c2c66-80a7-4cb3-b911-6cbe5f61ba56 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:44.828201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 142/280] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:44 2022] GET /identity/v3/users/8ebf9ca5451f44179b1ad452e35ac55d => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:44.829375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.829716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.829994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.847734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:44.848934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:44.886734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcb782-2981-46be-96f3-1654657fbf32 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:44.911554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:44.915866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 143/281] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:44.916694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:44.925732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:44.926351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:44.926627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:44.927029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:44.928273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:44.929144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.018725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5623bb-2000-4282-9cd3-5abdd142d545 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.021270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 139/282] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:46:44 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:45.022239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.079882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.080562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.080842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.081113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.094574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:45.100088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:45.101060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:45.101867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 144/283] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:45.108828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.153257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:45.168042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd438a-f768-4f2e-8c0e-f377dfee576a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.197955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:45.208232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.209079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.209899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.210341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.211211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, user.id=8ebf9ca5451f44179b1ad452e35ac55d, scope.system=all) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:45.211523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:45.213073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.218448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 140/284] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/role_assignments?user.id=8ebf9ca5451f44179b1ad452e35ac55d&scope.system=all&role.id=35a5b624e6db4cad87cd57e909000815 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:45.219338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.251319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c422df-2f26-48c7-a9d2-27739cb956f5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.295531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.296286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.296636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.296912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.297783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:45.298478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:45.299885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.309306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 145/285] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:45.315705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.360855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6c329-15c1-4c9c-a7a5-ca11708edb92 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.411514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.413015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.413500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.414010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.432249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:45.440858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:45.441793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:45.442600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:45.443208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 141/286] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:45.449498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.450328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78569-9b4b-4729-86ee-c7a0946d6d00 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.473994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:45.480710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:45.498853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.499494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.499770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.500039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] PATH_INFO: `/v3/users/7ca19f99f6024d4f947fbbf4118a71a0` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.502665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] RBAC: Authorizing `identity:get_user(user_id=7ca19f99f6024d4f947fbbf4118a71a0)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:45.504714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.506971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 146/287] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/users/7ca19f99f6024d4f947fbbf4118a71a0 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:45.513588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.609734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5223-64a2-48d4-8c3c-776dc24499f5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.669394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a72ac-fa6c-4cd3-a6d8-89936ebf6d15 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.689589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.690212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.690496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.690773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.691452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:45.691759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:45.693185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.704017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 142/288] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:45.710248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.710899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.711176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.711383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.711480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.712686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:45.714177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.716619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 147/289] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:45.723605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:45.837535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:45.858791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:45.916366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04207d47-29f9-443c-867d-a83ec424d5c8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.931804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf45c-c578-4c6c-9026-da07918efea0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:45.988203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:45.988866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:45.989142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:45.989414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] PATH_INFO: `/v3/users/a5d1ed1b4c844399bcb1156f548ffc18` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:45.991426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a5d1ed1b4c844399bcb1156f548ffc18)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:45.992913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:45.997956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 143/290] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/users/a5d1ed1b4c844399bcb1156f548ffc18 => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:46.003148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:46.015853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:46.016544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:46.016823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:46.017098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/7ca19f99f6024d4f947fbbf4118a71a0/roles/a7573ebc103d4a8898b99f1479793866` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:46.019166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2caddf9c1b4ea08235ed5e19f152ac, user_id=7ca19f99f6024d4f947fbbf4118a71a0, role_id=a7573ebc103d4a8898b99f1479793866)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:46.020623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:46.099515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 148/291] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:46:45 2022] PUT /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/users/7ca19f99f6024d4f947fbbf4118a71a0/roles/a7573ebc103d4a8898b99f1479793866 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:46.152443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c967d-18a4-4bb0-96d2-498b5b0438b2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:46.208830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:46.209380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:46.209658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:46.209928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:46.227752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:46.297816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:46.299283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:46.419658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 144/292] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:46.425347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:46.538498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e782641-8838-4837-9020-dd8c0261ec7f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:46.562966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:46.582261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bf474-108e-4dfc-92dc-d0cea5aa2a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:46.582889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bf474-108e-4dfc-92dc-d0cea5aa2a6e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:46.583168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bf474-108e-4dfc-92dc-d0cea5aa2a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:46.583442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bf474-108e-4dfc-92dc-d0cea5aa2a6e None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:46.592895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bf474-108e-4dfc-92dc-d0cea5aa2a6e None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:46.592895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bf474-108e-4dfc-92dc-d0cea5aa2a6e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:46.592895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 149/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:46 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:46.596026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:46.655450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:46.734727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b29ba-186b-43af-aada-00cfb1563a59 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:46.785495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:46.786479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:46.786960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:46.787451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:46.788427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=a5d1ed1b4c844399bcb1156f548ffc18) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:46.796062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:46.796062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1982b6d-c202-4326-9f79-ba4d85a8308c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:46.801158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 145/294] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:46 2022] GET /identity/v3/role_assignments?user.id=a5d1ed1b4c844399bcb1156f548ffc18&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=35a5b624e6db4cad87cd57e909000815 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:47.659067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4173c3-6727-4597-9887-24c700ca58a6 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:47.659917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4173c3-6727-4597-9887-24c700ca58a6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:47.660347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4173c3-6727-4597-9887-24c700ca58a6 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:47.662334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 150/295] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:47.667815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c1bd-5393-4224-a148-3e90cc5cb5f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:47.668678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c1bd-5393-4224-a148-3e90cc5cb5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:47.669471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c1bd-5393-4224-a148-3e90cc5cb5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:47.687838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1dd9c1bd-5393-4224-a148-3e90cc5cb5f7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:47.689417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1dd9c1bd-5393-4224-a148-3e90cc5cb5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:47.769980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 146/296] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:47.836650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41258086-c876-4205-810e-5117b1f6226f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:47.837264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41258086-c876-4205-810e-5117b1f6226f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:47.837726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41258086-c876-4205-810e-5117b1f6226f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:47.839658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 151/297] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:47.846186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d3eb-4029-4a36-8a70-cd6e7de36c99 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:47.846535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d3eb-4029-4a36-8a70-cd6e7de36c99 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:47.846866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d3eb-4029-4a36-8a70-cd6e7de36c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:47.868992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c5b5d3eb-4029-4a36-8a70-cd6e7de36c99 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:47.870840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c5b5d3eb-4029-4a36-8a70-cd6e7de36c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:47.901212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:47.951492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd98b-bb1b-4ab4-b349-4d35aa8f5d31 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:47.951677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd98b-bb1b-4ab4-b349-4d35aa8f5d31 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:47.951954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bd98b-bb1b-4ab4-b349-4d35aa8f5d31 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:47.952243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 147/298] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:47.953433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 152/299] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:47.968912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:47.969200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:47.969481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:47.988790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:47.989984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:48.063655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bd98b-bb1b-4ab4-b349-4d35aa8f5d31 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.073857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 148/300] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:48.175620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bd98b-bb1b-4ab4-b349-4d35aa8f5d31 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.210347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10498c91-5917-4067-9637-814b406369f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.210899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10498c91-5917-4067-9637-814b406369f4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.211178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10498c91-5917-4067-9637-814b406369f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.211451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10498c91-5917-4067-9637-814b406369f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.222683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10498c91-5917-4067-9637-814b406369f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-10498c91-5917-4067-9637-814b406369f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:48.228593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:48.229465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:48.230446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 153/301] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:46:48.237394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.258479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10498c91-5917-4067-9637-814b406369f4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.312910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:48.342910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:48.349439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9de81b-29b0-4b51-9573-3bd13d6f40db None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.378261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10498c91-5917-4067-9637-814b406369f4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.384658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.385518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.386006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.386683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.387364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:48.387669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:48.389698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:48.403368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 149/302] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:48.403368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.419580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.420296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.420619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.421127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.422003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:48.423425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:48.425241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 154/303] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:48.425863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.509778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae01d7-1829-4523-96a0-199d8c9ff5f5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.534180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5203f-2e7c-4a31-be4d-3206889acb3d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.545712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.546662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.547083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.547504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.551142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:48.559595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:48.565563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:48.566498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:48.567284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 150/304] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:48.567959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.582082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.582731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.583010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.583284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] PATH_INFO: `/v3/users/8ebf9ca5451f44179b1ad452e35ac55d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.584472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=8ebf9ca5451f44179b1ad452e35ac55d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:48.585925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:48.587507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 155/305] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/users/8ebf9ca5451f44179b1ad452e35ac55d => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:48.588266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.597713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:48.683798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18a0aa-b555-4a48-9b63-a8d1b3f996b4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.693350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6f04-8998-4548-b05b-e9d9f3da3fc8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.719135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24cf20-b4e7-4640-bced-4ac40fa2ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.719742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24cf20-b4e7-4640-bced-4ac40fa2ae01 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.720024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24cf20-b4e7-4640-bced-4ac40fa2ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.720332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24cf20-b4e7-4640-bced-4ac40fa2ae01 None admin] PATH_INFO: `/v3/groups` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.720960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24cf20-b4e7-4640-bced-4ac40fa2ae01 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:48.722431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24cf20-b4e7-4640-bced-4ac40fa2ae01 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:48.725497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.726100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.726382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.726650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.727303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:48.727605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:48.728976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:48.736964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 156/306] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:48.737718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.781999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:48.824949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 151/307] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Sep 15 10:46:48 2022] POST /identity/v3/groups => generated 229 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:48.826986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99fa33-bb6f-4954-b5bb-cad7b4aa6fa1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.827264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99fa33-bb6f-4954-b5bb-cad7b4aa6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.827532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99fa33-bb6f-4954-b5bb-cad7b4aa6fa1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.828813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 152/308] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:48.829572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99fa33-bb6f-4954-b5bb-cad7b4aa6fa1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:48.847900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4bd64-9a65-430c-9cc1-fc95217ec335 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.892173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028664-2c8f-45c4-8c4b-db95584a2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.892903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028664-2c8f-45c4-8c4b-db95584a2013 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.893181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028664-2c8f-45c4-8c4b-db95584a2013 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.893454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028664-2c8f-45c4-8c4b-db95584a2013 None admin] PATH_INFO: `/v3/system/users/8ebf9ca5451f44179b1ad452e35ac55d/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.894928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028664-2c8f-45c4-8c4b-db95584a2013 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8ebf9ca5451f44179b1ad452e35ac55d, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:48.896298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c028664-2c8f-45c4-8c4b-db95584a2013 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:48.924848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:48.948268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99fa33-bb6f-4954-b5bb-cad7b4aa6fa1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:48.985836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 157/309] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Sep 15 10:46:48 2022] PUT /identity/v3/system/users/8ebf9ca5451f44179b1ad452e35ac55d/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:46:48.987486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.987844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.988190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:48.993276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:48.994411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:48.995622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:48.996332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] PATH_INFO: `/v3/users/93196c3c7c4d4e0da7756e33eab41e81` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:49.011072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:49.013539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:49.016176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=93196c3c7c4d4e0da7756e33eab41e81)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:49.018895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:49.021015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 153/310] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:48 2022] GET /identity/v3/users/93196c3c7c4d4e0da7756e33eab41e81 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:49.030086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:49.119016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 158/311] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:49.167711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d27f-306a-433f-ae66-e7bc9e3f6cb1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:49.204631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:49.205583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:49.206054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:49.206541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:49.207495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] RBAC: Adding query filter params (role.id=a7573ebc103d4a8898b99f1479793866, user.id=93196c3c7c4d4e0da7756e33eab41e81, scope.system=all) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:49.208038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:49.209699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:49.213247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:49.217098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 154/312] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 15 10:46:49 2022] GET /identity/v3/role_assignments?user.id=93196c3c7c4d4e0da7756e33eab41e81&scope.system=all&role.id=a7573ebc103d4a8898b99f1479793866 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:49.410355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:49.450030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:49.515440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc31666-e987-4d71-b8e6-48bd699045e9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:49.553820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:49.554457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:49.554736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:49.555011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:49.565683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:49.570708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:49.571627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:49.572680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 159/313] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:49.577840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:49.691928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa11d8-7602-47a8-a14a-9ffc916a0984 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:49.728499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:49.729114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:49.729395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:49.729671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:49.730342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:49.730646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:49.732594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:49.742028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 155/314] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:49.747475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:49.851779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:49.856092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41d469-b44c-4ed9-a054-0a4bf5ddfaa7 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:49.895660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:49.896297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:49.896672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:49.896951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] PATH_INFO: `/v3/users/7ca19f99f6024d4f947fbbf4118a71a0` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:49.898166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] RBAC: Authorizing `identity:get_user(user_id=7ca19f99f6024d4f947fbbf4118a71a0)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:49.899894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:49.901852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 160/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:49 2022] GET /identity/v3/users/7ca19f99f6024d4f947fbbf4118a71a0 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:49.907547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:49.985007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:50.029036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a16cb-a095-4786-9a5a-db43ce17041d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:50.063328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:50.063941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:50.064224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:50.064533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:50.138671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:50.140154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:50.204141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:50.246043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 156/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:50.252131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:50.354307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881e1b-904e-4de4-a8fb-258265fe761f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:50.389801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5e052-ae92-493c-8120-099237dc41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:50.390435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5e052-ae92-493c-8120-099237dc41b5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:50.390716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5e052-ae92-493c-8120-099237dc41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:50.390988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5e052-ae92-493c-8120-099237dc41b5 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:50.392105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5e052-ae92-493c-8120-099237dc41b5 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:50.393680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5e052-ae92-493c-8120-099237dc41b5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:50.395656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 161/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:50 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:50.401467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:50.503219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49898f3-7017-442a-87d2-5b25f09f0787 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:50.537756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:50.538362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:50.538639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:50.538910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:50.539625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] RBAC: Adding query filter params (role.id=a7573ebc103d4a8898b99f1479793866, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac, user.id=7ca19f99f6024d4f947fbbf4118a71a0) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:50.539927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:50.541390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2711c7-a6f2-44e3-a07f-56ed59ce8f5a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:50.548379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 157/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:46:50 2022] GET /identity/v3/role_assignments?user.id=7ca19f99f6024d4f947fbbf4118a71a0&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=a7573ebc103d4a8898b99f1479793866 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:51.160561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e509ce9-2fde-4b02-b8bc-860a7f9ae4cc None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.161070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e509ce9-2fde-4b02-b8bc-860a7f9ae4cc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.161070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e509ce9-2fde-4b02-b8bc-860a7f9ae4cc None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.162461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 162/319] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:51.167603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e0fa6-56d6-41fa-8d06-dbb80a5cd6b4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.167979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e0fa6-56d6-41fa-8d06-dbb80a5cd6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.168142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e0fa6-56d6-41fa-8d06-dbb80a5cd6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.186212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a44e0fa6-56d6-41fa-8d06-dbb80a5cd6b4 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:51.187374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a44e0fa6-56d6-41fa-8d06-dbb80a5cd6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:51.208887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:51.261776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 158/320] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:51.339003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fef15-d548-4af2-ba25-495a97d007d6 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.339286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fef15-d548-4af2-ba25-495a97d007d6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.339480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fef15-d548-4af2-ba25-495a97d007d6 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.341052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 163/321] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:51.346342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.346640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.346921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.365913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:51.367097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:51.390288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac1aa-aa0d-41d8-ac1b-dfa79f9569b3 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.390562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac1aa-aa0d-41d8-ac1b-dfa79f9569b3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.390837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac1aa-aa0d-41d8-ac1b-dfa79f9569b3 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.392150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 164/322] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:46:51.396875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.397157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.397452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.415932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:51.417142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:51.439696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 159/323] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:51.445197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:51.481072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:46:51.539308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:51.622994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:51.637541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c2447-3b9f-4adb-9b04-60597a4f1eb5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:51.670904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:51.671519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.671798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.672068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.673171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:51.674592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:51.676376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 160/325] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:51.681775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:51.708890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:51.788112 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0921-78cd-4f47-b311-85dc940600ff None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:51.812050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3c70f-fd27-42cc-a2aa-2aa79bb3aedb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:51.821836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:51.822433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.822711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.822986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] PATH_INFO: `/v3/groups` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.823610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:51.825056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:51.846783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:51.847403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:51.847683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:51.847957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:51.858100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:51.863194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:51.864234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 161/326] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:46:51.865086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:51.882053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:51.926902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 166/327] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Sep 15 10:46:51 2022] POST /identity/v3/groups => generated 226 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:46:51.927808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:51.970649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:51.986015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965f895-008e-4a47-afa4-1ec9aff37afc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.026228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.027630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.028692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.029453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.044759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:52.050460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:52.051561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:52.052540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:52.054525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 162/328] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:52.061137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:52.062326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad795fe-a8e7-4fc1-bf48-b28e39cba2cb None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.100442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.101062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.101334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.101607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.102269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:52.102563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:52.103946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:52.114671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 167/329] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:52.121762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:52.154451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:52.181147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fdaa6-9378-4814-958d-6c3ccddc4cf7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.226639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.227296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.227576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.227852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.228599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:52.228904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:52.229455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:52.230311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:52.239306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 163/330] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:52.245290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:52.245411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37e4da-9bce-4a81-8829-caa76b18521c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.283776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.284480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.284757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.285026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] PATH_INFO: `/v3/users/8ebf9ca5451f44179b1ad452e35ac55d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.286160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] RBAC: Authorizing `identity:get_user(user_id=8ebf9ca5451f44179b1ad452e35ac55d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:52.287595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:52.290750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 168/331] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:52 2022] GET /identity/v3/users/8ebf9ca5451f44179b1ad452e35ac55d => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:52.295854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:52.376963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721c06-6aba-40c4-8864-97f1f3f585f5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.425284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.425848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.426131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.426633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] PATH_INFO: `/v3/users/93196c3c7c4d4e0da7756e33eab41e81` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.427515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] RBAC: Authorizing `identity:get_user(user_id=93196c3c7c4d4e0da7756e33eab41e81)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:52.428989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:52.429314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d712-a46c-45ab-9e54-c8349903110a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.432462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 164/332] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:52 2022] GET /identity/v3/users/93196c3c7c4d4e0da7756e33eab41e81 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:52.436933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:52.442846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:52.480248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.480924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.481210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.481541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.482606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] RBAC: Adding query filter params (role.id=35a5b624e6db4cad87cd57e909000815, user.id=8ebf9ca5451f44179b1ad452e35ac55d, scope.system=all) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:52.482921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:52.484383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece14b-9096-4502-a0b1-8e14c7cff765 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:52.498523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 169/333] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 15 10:46:52 2022] GET /identity/v3/role_assignments?user.id=8ebf9ca5451f44179b1ad452e35ac55d&scope.system=all&role.id=35a5b624e6db4cad87cd57e909000815 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:52.561898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a0c00-8398-4737-9e1e-85a690bcad9e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:52.601378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcace389-c715-4a44-b6c7-c9a594680eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:52.602399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcace389-c715-4a44-b6c7-c9a594680eb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:52.602878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcace389-c715-4a44-b6c7-c9a594680eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:52.603325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcace389-c715-4a44-b6c7-c9a594680eb0 None admin] PATH_INFO: `/v3/system/users/93196c3c7c4d4e0da7756e33eab41e81/roles/a7573ebc103d4a8898b99f1479793866` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:52.605030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcace389-c715-4a44-b6c7-c9a594680eb0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=93196c3c7c4d4e0da7756e33eab41e81, role_id=a7573ebc103d4a8898b99f1479793866)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:52.606731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcace389-c715-4a44-b6c7-c9a594680eb0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:52.694645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 165/334] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Sep 15 10:46:52 2022] PUT /identity/v3/system/users/93196c3c7c4d4e0da7756e33eab41e81/roles/a7573ebc103d4a8898b99f1479793866 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:46:54.520676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd554b-76df-4607-bce4-baac642eca6f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:54.521668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd554b-76df-4607-bce4-baac642eca6f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:54.522142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd554b-76df-4607-bce4-baac642eca6f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:54.523972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 170/335] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:54.535366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8954-e0e3-4cf8-a19d-bb1f63b63a66 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:54.536252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8954-e0e3-4cf8-a19d-bb1f63b63a66 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:54.536810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8954-e0e3-4cf8-a19d-bb1f63b63a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:54.556887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7c0f8954-e0e3-4cf8-a19d-bb1f63b63a66 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:54.558411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7c0f8954-e0e3-4cf8-a19d-bb1f63b63a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:54.648118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:54.656166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 166/336] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:54.894949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020c512-34b2-4806-b75d-94adfa43af30 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:54.895641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020c512-34b2-4806-b75d-94adfa43af30 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:54.896117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020c512-34b2-4806-b75d-94adfa43af30 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:54.897935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 171/337] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:54.903059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953836-260c-4c3f-a34b-0eb6739699da None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:54.903718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953836-260c-4c3f-a34b-0eb6739699da None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:54.904193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953836-260c-4c3f-a34b-0eb6739699da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:54.929381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a5953836-260c-4c3f-a34b-0eb6739699da None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:54.930836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5953836-260c-4c3f-a34b-0eb6739699da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:55.031087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 167/338] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:55.101369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409b263-7246-4e36-ba12-2b746a233743 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:55.101952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409b263-7246-4e36-ba12-2b746a233743 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:55.102407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409b263-7246-4e36-ba12-2b746a233743 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:55.104184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 172/339] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:55.109843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:55.110384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:55.110870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:55.132866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:55.134319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:55.210901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409b263-7246-4e36-ba12-2b746a233743 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:55.230837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 168/340] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:55.236673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:55.353582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409b263-7246-4e36-ba12-2b746a233743 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:55.395764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:55.396418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:55.396696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:55.396967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:55.411563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:55.416976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:55.417898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:55.418707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:55.422861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 173/341] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:46:55.424342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:55.448344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:55.546465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:55.555903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:55.589730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6962b4-9c0f-49ff-9ab6-e9123fb833d4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:55.634223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:55.634971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:55.635250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:55.635519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:55.650740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:55.658697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3015e3-c7a4-46bc-b107-deb9372b1992 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:55.665763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:55.666711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:55.667501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 174/342] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:55.674448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:55.740702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:55.741320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:55.741606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:55.741883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:55.742561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:55.742866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:55.744235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:55.766554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 169/343] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:55.776797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:55.808290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c19a3a-cbe6-4d5b-93da-5a9561d9a749 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:55.868194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:55.876155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:55.876792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:55.877085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:55.877324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:55.877985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:55.878277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:55.879956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:55.905059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 175/344] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:55.905934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:55.991136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f21fc0-d2ef-4df9-a7a9-b2d7ef0ad877 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.037280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.065057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.066075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.066557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.067064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.089684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:56.095167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:56.096062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:46:56.096985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:56.097631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151d6ab-0ea9-4dc7-a9b7-0a29fa91ebd8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.099905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 170/345] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:56.101077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:56.136324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e289f1-1846-422a-9ceb-d58a642e1bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.136939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e289f1-1846-422a-9ceb-d58a642e1bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.137212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e289f1-1846-422a-9ceb-d58a642e1bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.137482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e289f1-1846-422a-9ceb-d58a642e1bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.208721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.218348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e289f1-1846-422a-9ceb-d58a642e1bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:56.220657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e289f1-1846-422a-9ceb-d58a642e1bf5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:56.244992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6e634-cfb7-43b3-a6e7-5fe37031b537 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.292327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa3fc0-c6c3-4c39-bf0f-95310bca3ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.293103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3fc0-c6c3-4c39-bf0f-95310bca3ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.293387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3fc0-c6c3-4c39-bf0f-95310bca3ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.293666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa3fc0-c6c3-4c39-bf0f-95310bca3ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.339573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 176/346] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:56.341318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e0755-3131-482f-9cbf-cb1229f6c90a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.341974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e0755-3131-482f-9cbf-cb1229f6c90a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.342541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e0755-3131-482f-9cbf-cb1229f6c90a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.344269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 177/347] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:56.345311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e0755-3131-482f-9cbf-cb1229f6c90a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:56.353517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.379752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa3fc0-c6c3-4c39-bf0f-95310bca3ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:56.381222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa3fc0-c6c3-4c39-bf0f-95310bca3ee3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:56.454773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.463333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e0755-3131-482f-9cbf-cb1229f6c90a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.506598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.507636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.508108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.508904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.509792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:56.510283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:56.511872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:56.521790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 178/348] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:56.522939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:56.530332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 171/349] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:56.531626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803522c-60ab-4ae3-8d5d-8f93d00bf207 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.531910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803522c-60ab-4ae3-8d5d-8f93d00bf207 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.532186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803522c-60ab-4ae3-8d5d-8f93d00bf207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.552240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9803522c-60ab-4ae3-8d5d-8f93d00bf207 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:56.553465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9803522c-60ab-4ae3-8d5d-8f93d00bf207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:56.632182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 172/350] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:56.633538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3ff8-e1b4-4bf1-91de-6d4b22fdc854 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.633823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3ff8-e1b4-4bf1-91de-6d4b22fdc854 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.634221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3ff8-e1b4-4bf1-91de-6d4b22fdc854 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.635518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 173/351] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:56.636271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3ff8-e1b4-4bf1-91de-6d4b22fdc854 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:56.658039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3569151-59a5-4d43-a6f2-287f22763cc7 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.668081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.711656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.712455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.712734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.713007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.714399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:56.716962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:56.718872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 179/352] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:56 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:56.721046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:56.758148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.772016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3ff8-e1b4-4bf1-91de-6d4b22fdc854 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.812647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.813627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.814127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.814595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.859777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7953a-5c26-445e-96f3-845ac9a729b6 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:56.905435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f99795-580c-441d-a998-f9f218a3f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:56.905985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99795-580c-441d-a998-f9f218a3f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.906260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99795-580c-441d-a998-f9f218a3f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.906532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99795-580c-441d-a998-f9f218a3f4d8 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.907791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99795-580c-441d-a998-f9f218a3f4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:56.909877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99795-580c-441d-a998-f9f218a3f4d8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:56.911954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 180/353] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:56 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:56.913720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:56.914008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:56.914282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:56.916266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:56.917992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:56.932801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:56.937399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:56.938994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:57.030135 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 181/354] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:57.031499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.057520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:57.063757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 174/355] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:57.064479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.167927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d167d-2c10-4882-b31b-4c8eb3f159cc None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.186701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0f77b-81c2-4d89-9b10-62b170264526 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.198042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:57.213909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.214679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.214966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.215242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.228351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:57.230470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:57.233717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 182/356] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:57.234730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.236007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.236855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.237308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.237995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.240300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:57.242201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:57.244240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 175/357] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:57.245808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.348381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:57.366945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77632-d082-4d1b-9120-c58b91751079 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.372106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02553c-e1a3-452e-b763-824cf38c0310 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.413414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.413960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.414204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.416467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.416588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.416669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.416750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.416750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.416996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:57.418500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:57.424611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 176/358] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:57.425321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.426989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:57.432608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:57.433673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:57.434974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 183/359] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:57.436858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.483569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:57.544101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3fc24-d274-41ac-b9ae-06b67b116814 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.545186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ebbcb-9c26-4d03-8c74-75281c5c581e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.586116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.586730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.587013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.587290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.588015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:57.588348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:57.588459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.588959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.589239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.589513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.589774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a095-de5d-4ecb-b59c-f66ba6d78bd1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:57.590245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:57.590550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:57.592097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:57.595696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 184/360] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=9efddb790ba641d59d0f165b116e2876 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:57.596921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87cb44-279f-4e4a-987d-3282389968f9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.597205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87cb44-279f-4e4a-987d-3282389968f9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.597482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87cb44-279f-4e4a-987d-3282389968f9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.598117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 177/361] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=35a5b624e6db4cad87cd57e909000815 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:57.598702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 185/362] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:46:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:46:57.598911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.599408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87cb44-279f-4e4a-987d-3282389968f9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.613974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:57.743053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203aa3c-3e81-4d3e-b24d-9eb9ca7da625 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.761356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:57.773228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87cb44-279f-4e4a-987d-3282389968f9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.801148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.802553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.802842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.803126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.818250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:57.826393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:57.827371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 178/363] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:57.832043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.835906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cabb35-9a23-42e2-ab37-d63f2a53c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:57.835906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cabb35-9a23-42e2-ab37-d63f2a53c608 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.835906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cabb35-9a23-42e2-ab37-d63f2a53c608 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.835906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cabb35-9a23-42e2-ab37-d63f2a53c608 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.836683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cabb35-9a23-42e2-ab37-d63f2a53c608 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:57.838114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cabb35-9a23-42e2-ab37-d63f2a53c608 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:57.839979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 186/364] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:57.845394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:57.845680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:57.846030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:57.865245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:46:57.866702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:46:57.957333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf7500-c73d-4d07-83ad-b0d466a0cc77 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:57.963143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 187/365] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:46:57.964010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:57.978063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:58.013169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.013169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.013169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.013169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.013763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:58.014072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.015486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.041959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 179/366] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:58.042648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.094904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:58.096599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3004-33d2-4e72-90aa-b470f2a166c6 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.139229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.140257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.140704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.141624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.142442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:58.142982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.144959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.155892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 188/367] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:46:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:58.157148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.185154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534718b-31b5-4479-9e4b-1dbfe4a8665c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.231199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.231998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.232504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.232936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.233809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:58.234278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.235914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.242216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 180/368] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=35a5b624e6db4cad87cd57e909000815 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:58.243176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.245956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:58.292741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5e45-7015-4752-ba84-f00b5a5a0316 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.362009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.362944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.363366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.363780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] PATH_INFO: `/v3/users/93196c3c7c4d4e0da7756e33eab41e81` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.367908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] RBAC: Authorizing `identity:get_user(user_id=93196c3c7c4d4e0da7756e33eab41e81)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.369594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.371413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 189/369] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/users/93196c3c7c4d4e0da7756e33eab41e81 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:58.377994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.401261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:58.408218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff181f-c0a0-46e3-9c2d-7c2b0410daf1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.454257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.455120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.455542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.455957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.546270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde30c9d-402e-45ca-bed6-949d24bed219 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.559338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.561491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.592540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.593214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.593512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.594043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.594777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] RBAC: Adding query filter params (role.id=a7573ebc103d4a8898b99f1479793866, user.id=93196c3c7c4d4e0da7756e33eab41e81, scope.system=all) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:58.595087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.597378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.602969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:58.613298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 190/370] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/role_assignments?user.id=93196c3c7c4d4e0da7756e33eab41e81&scope.system=all&role.id=a7573ebc103d4a8898b99f1479793866 => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:58.614046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.679160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:58.688670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 181/371] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:58.694702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.770355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79db95-1b69-4399-ae04-4c918e0656ad None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.872860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892f3d-dfd0-48aa-8543-30fad31bb916 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:58.898671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.899317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.900348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.900348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.933522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:46:58.948850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:46:58.949828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:46:58.950762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:46:58.951458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 191/372] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:46:58.956711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:58.983569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:58.983569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:58.983966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:58.984120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:58.986026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:58.987482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:58.990310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 182/373] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:58.995454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:59.079642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:59.133216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:59.162876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d31aa-7c2c-40b8-9352-640a9c2d544b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:59.224359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:59.225001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:59.225279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:59.225550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:59.226222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:59.227977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:59.229397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:59.237708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172f23-750a-4863-a174-3e95dfc7d59a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:59.246641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 192/374] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:46:59.253433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:59.360022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:59.361071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:59.361547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:59.362076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:59.363397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:59.369185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:59.371325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 183/375] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:46:58 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:59.381179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:59.396429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82662-77cc-4ddb-a1b0-0fbd49eeb60c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:59.435188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:59.506387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:59.507012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:59.507294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:59.507572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:59.644013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac3e8-cef4-433e-a04f-7cf4f85df637 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:46:59.654422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:59.655806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:59.706544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:46:59.721183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:46:59.721801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:46:59.722083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:46:59.722358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:46:59.723099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:46:59.723407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:46:59.724875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:46:59.736967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 184/376] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:46:59 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=9efddb790ba641d59d0f165b116e2876 => generated 260 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:46:59.815195 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 193/377] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:46:59.821149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:46:59.955627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fb47b-60f8-4e80-ac8a-3f92a180d5cf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:00.003065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:00.003794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:00.004723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:00.004723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] PATH_INFO: `/v3/projects/fcc2355d0a64457f8c16a6298a1d7815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:00.008125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] RBAC: Authorizing `identity:get_project(project_id=fcc2355d0a64457f8c16a6298a1d7815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:00.008125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:00.009130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 185/378] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:46:59 2022] GET /identity/v3/projects/fcc2355d0a64457f8c16a6298a1d7815 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:00.016127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:00.048681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:00.131751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10ca5-28f7-43ad-b493-c0b5b80921f5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:00.172457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571760a-c5cd-4e3d-b923-7d8e2816ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:00.173149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571760a-c5cd-4e3d-b923-7d8e2816ca04 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:00.173432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571760a-c5cd-4e3d-b923-7d8e2816ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:00.173706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571760a-c5cd-4e3d-b923-7d8e2816ca04 None admin] PATH_INFO: `/v3/groups/153da63b69f1424f8d9f27975526604d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:00.185056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571760a-c5cd-4e3d-b923-7d8e2816ca04 None admin] RBAC: Authorizing `identity:get_group(group_id=153da63b69f1424f8d9f27975526604d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:00.186568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571760a-c5cd-4e3d-b923-7d8e2816ca04 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:00.188446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 194/379] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:00 2022] GET /identity/v3/groups/153da63b69f1424f8d9f27975526604d => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:00.194000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:00.291215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:00.346254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc72c1-9cd7-415e-aef5-1f83e5a9985a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:00.390497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:00.391467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:00.391942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:00.392453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:00.393421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] RBAC: Adding query filter params (group.id=153da63b69f1424f8d9f27975526604d, role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=fcc2355d0a64457f8c16a6298a1d7815) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:00.393927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:00.395561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e6134-dcb7-45dd-b0b9-555c81981063 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:00.406390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 186/380] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:47:00 2022] GET /identity/v3/role_assignments?group.id=153da63b69f1424f8d9f27975526604d&scope.project.id=fcc2355d0a64457f8c16a6298a1d7815&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:00.635861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77e23-9039-4701-b107-503cad2c4904 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:00.636563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77e23-9039-4701-b107-503cad2c4904 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:00.637037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77e23-9039-4701-b107-503cad2c4904 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:00.639953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 195/381] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:00.645743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:00.646277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:00.646790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:00.668914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:00.670532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:00.755586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 187/382] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:01.113721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd5311-a96f-4736-963d-a53f5d6104c0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.114248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd5311-a96f-4736-963d-a53f5d6104c0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.114248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd5311-a96f-4736-963d-a53f5d6104c0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.116073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 196/383] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:01.117122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:01.132957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.133296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.133511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.160935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:01.162145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:01.246423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:01.311734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 197/384] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:01.322235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ea99-402c-4348-97a7-afd6123f815e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:01.381399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce965cb8-8b85-450e-83b0-ae6e2eb54908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:01.382048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965cb8-8b85-450e-83b0-ae6e2eb54908 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.382325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965cb8-8b85-450e-83b0-ae6e2eb54908 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.382598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce965cb8-8b85-450e-83b0-ae6e2eb54908 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.393349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce965cb8-8b85-450e-83b0-ae6e2eb54908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ce965cb8-8b85-450e-83b0-ae6e2eb54908 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:01.398129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:01.399006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:01.399828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 188/385] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:01.405954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:01.425120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:01.477426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bbaa7-8fdc-4655-b0ab-1e138eb9c57e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.477709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bbaa7-8fdc-4655-b0ab-1e138eb9c57e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.477975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bbaa7-8fdc-4655-b0ab-1e138eb9c57e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.479575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 189/386] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:01.485495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.485780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.486057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.504943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:01.506120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:01.534627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556ef34-4c72-4232-a4ce-f9dd0eca700c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:01.597967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 190/387] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:01.598874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:01.599490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.599772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.600050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.600749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:01.601055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:01.602425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:01.619810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 198/388] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:01.625272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:01.636212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:01.696172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:01.776740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:01.806013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb27ce-719c-4957-bd70-d612820985b1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:01.818601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcafe3-17d0-4494-afe6-5a6b4513afff None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:01.878233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:01.879316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.879977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.881280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:01.881754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.883124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:01.883868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:01.884332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:01.885930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:01.886379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:01.894302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 191/389] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:01 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:01.898562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:01.899908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:01.910213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:01.911221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:01.912008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:01.914455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 199/390] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:01.924330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.050299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9478d-4259-4ddc-833b-ba799e24f033 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.058722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43277795-3377-4062-897b-3e7d40bad5f0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.080022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:02.091664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.092689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.093238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.093984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.096963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:02.096963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.097733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.100741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:02.105891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.107600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.107783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 200/391] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:02.108405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.108872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.109313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.110134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.111576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.118239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 192/392] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:01 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:02.118239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.221390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22424f06-1aeb-4aea-9ce1-6f6eed721e37 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.252825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516165b9-62e5-4f65-9115-f825c21a3e55 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.258883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.259740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.260226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.260796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.273401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:02.280783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:02.281689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:02.282491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:02.289846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 201/393] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:02.289846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.298344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.298989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.299268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.299546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.300918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.302360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.304413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 193/394] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:02 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:02.305385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.364267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:02.381299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:02.408451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4ae21-eb65-4aad-b444-67492284ddcc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.444695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4998-1ff1-4306-901b-65c64787f188 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.456219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab78da-d97a-4426-8bce-89cdcbb03a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.457199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab78da-d97a-4426-8bce-89cdcbb03a5e None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.457729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab78da-d97a-4426-8bce-89cdcbb03a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.458221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab78da-d97a-4426-8bce-89cdcbb03a5e None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/groups/064968f04af94b108f2014cf28793ed5/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.460630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab78da-d97a-4426-8bce-89cdcbb03a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=46954ca73fa842eeb4c3abc44e35f9fe, group_id=064968f04af94b108f2014cf28793ed5, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.462383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab78da-d97a-4426-8bce-89cdcbb03a5e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.480031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.480594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.480868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.481169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.482356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:02.482830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.484177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.492902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 194/395] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:47:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:02.493680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.538304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 202/396] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 15 10:47:02 2022] PUT /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/groups/064968f04af94b108f2014cf28793ed5/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:02.538304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f4855-e154-4482-b7dc-cf2c2105ab9a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.538304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f4855-e154-4482-b7dc-cf2c2105ab9a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.538304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f4855-e154-4482-b7dc-cf2c2105ab9a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.538304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 203/397] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:02.538304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f4855-e154-4482-b7dc-cf2c2105ab9a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.618980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa71c-929c-4858-b72b-2bfad51b545a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.639679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:02.666329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536556-d25c-4b30-b71b-dde166bf1926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.667124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536556-d25c-4b30-b71b-dde166bf1926 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.667422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536556-d25c-4b30-b71b-dde166bf1926 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.667703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536556-d25c-4b30-b71b-dde166bf1926 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.670376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51536556-d25c-4b30-b71b-dde166bf1926 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.672455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51536556-d25c-4b30-b71b-dde166bf1926 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.674717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 195/398] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:02 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:02.676037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.676341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.676628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.687239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f4855-e154-4482-b7dc-cf2c2105ab9a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.699961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:02.702100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:02.708255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:02.736738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.738031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.738635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.739252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.741426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.743584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.746289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 204/399] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:02 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:02.747567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.802540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 196/400] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:02.803965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:02.887351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f0f6-47be-498b-ad2c-dd3516aedfe5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.959678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:02.961382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:02.961687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:02.961962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/groups/064968f04af94b108f2014cf28793ed5/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:02.967431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] RBAC: Authorizing `identity:create_grant(project_id=46954ca73fa842eeb4c3abc44e35f9fe, group_id=064968f04af94b108f2014cf28793ed5, role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:02.968915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:02.976107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11964f7-b6f6-4e3e-b153-90c9cf7af3df None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:02.992515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:03.014988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:03.015627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.015913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.016191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.019013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:03.019013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:03.020808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 197/401] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:02 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:03.026937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:03.051537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 205/402] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 15 10:47:02 2022] PUT /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe/groups/064968f04af94b108f2014cf28793ed5/roles/9efddb790ba641d59d0f165b116e2876 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:03.105399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:03.184732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:03.215108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ea630-a178-4a0b-a738-f65103e67322 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:03.263049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05137679-b80e-433e-a202-25f46fbaaf43 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:03.300467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:03.301147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.301424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.301696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/groups/064968f04af94b108f2014cf28793ed5/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.302873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bae4a1-0bae-4a78-8ebb-60aa1c12cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:03.303593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae4a1-0bae-4a78-8ebb-60aa1c12cb1e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.303783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2caddf9c1b4ea08235ed5e19f152ac, group_id=064968f04af94b108f2014cf28793ed5, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:03.303900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae4a1-0bae-4a78-8ebb-60aa1c12cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.304136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae4a1-0bae-4a78-8ebb-60aa1c12cb1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.305532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:03.316199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bae4a1-0bae-4a78-8ebb-60aa1c12cb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-19bae4a1-0bae-4a78-8ebb-60aa1c12cb1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:03.321442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:03.328405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 206/403] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:03.329509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49039-a425-42bd-ae5a-51abdf4bf2dc None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.330698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49039-a425-42bd-ae5a-51abdf4bf2dc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.330698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49039-a425-42bd-ae5a-51abdf4bf2dc None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.330698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 207/404] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:03.331903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.331903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.332351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.351386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:03.353027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:03.408457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 198/405] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 15 10:47:03 2022] PUT /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/groups/064968f04af94b108f2014cf28793ed5/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:47:03.409546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:03.440018 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 208/406] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:03.507448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:03.592017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0a83-2315-4375-90ab-c9b18362d030 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:03.640111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:03.640763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.641045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.641321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.642017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:03.642321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:03.643740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:03.656947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 199/407] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:03.662634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:03.711024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:03.754050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:03.822050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062ad38-15dd-4f8d-8b7e-254464aec3ed None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:03.896618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:03.897252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:03.897533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:03.897806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:03.899674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:03.902015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:03.910935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 209/408] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:03 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:03.919270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:03.944166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344de14-fdd4-476c-902c-c857a1b14629 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:03.946640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:04.009390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.010052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.010298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.010579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.022130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:04.032922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:04.035415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 200/409] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:04.036214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:04.165595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5b649-2d5a-4d4d-9eac-6a259231ac7a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:04.167409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:04.177677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b99a7f-1b63-4143-99bd-322ff3c27b0b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:04.221167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.221764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.222048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.222321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.223452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:04.224922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:04.231334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 210/410] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:03 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:04.232525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:04.293539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.294557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.295018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.295467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.296328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:04.296811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:04.298399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:04.319446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 201/411] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:04.341426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:04.347004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0ab8-ded7-4388-864c-5367c915efd1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:04.390398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.391176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.392597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.393304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/groups/064968f04af94b108f2014cf28793ed5/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.399925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2caddf9c1b4ea08235ed5e19f152ac, group_id=064968f04af94b108f2014cf28793ed5, role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:04.401524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:04.426987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:04.481698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 211/412] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 15 10:47:04 2022] PUT /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac/groups/064968f04af94b108f2014cf28793ed5/roles/9efddb790ba641d59d0f165b116e2876 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:47:04.503618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826df5f-deaa-46eb-891b-6757dbded69f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:04.541965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.542622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.542904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.543187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] PATH_INFO: `/v3/groups/153da63b69f1424f8d9f27975526604d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.549294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] RBAC: Authorizing `identity:get_group(group_id=153da63b69f1424f8d9f27975526604d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:04.550848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:04.553961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 202/413] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:04 2022] GET /identity/v3/groups/153da63b69f1424f8d9f27975526604d => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:04.562982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:04.620439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:04.730321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cc165-5fed-4887-9ec5-dcefa3708dff None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:04.792890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d2c3a-f44a-4054-8e48-42f300374dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.792890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d2c3a-f44a-4054-8e48-42f300374dae None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.792890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d2c3a-f44a-4054-8e48-42f300374dae None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.792890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d2c3a-f44a-4054-8e48-42f300374dae None admin] PATH_INFO: `/v3/projects/fcc2355d0a64457f8c16a6298a1d7815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.794489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d2c3a-f44a-4054-8e48-42f300374dae None admin] RBAC: Authorizing `identity:get_project(project_id=fcc2355d0a64457f8c16a6298a1d7815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:04.794489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d2c3a-f44a-4054-8e48-42f300374dae None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:04.794489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 212/414] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:04 2022] GET /identity/v3/projects/fcc2355d0a64457f8c16a6298a1d7815 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:04.803122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:04.912927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:04.926872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c269-ef95-4f0b-ba44-8afc20ff9dde None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:04.984600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:04.985195 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:04.985473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:04.985747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] PATH_INFO: `/v3/projects/fcc2355d0a64457f8c16a6298a1d7815/groups/153da63b69f1424f8d9f27975526604d/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:04.993611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcc2355d0a64457f8c16a6298a1d7815, group_id=153da63b69f1424f8d9f27975526604d, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:04.995089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:05.057379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8925-e553-47b1-aaf0-eef2d9319299 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:05.057680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8925-e553-47b1-aaf0-eef2d9319299 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:05.058032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8925-e553-47b1-aaf0-eef2d9319299 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:05.060325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 213/415] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:05.065501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:05.065787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:05.066060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:05.087666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 203/416] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Sep 15 10:47:04 2022] PUT /identity/v3/projects/fcc2355d0a64457f8c16a6298a1d7815/groups/153da63b69f1424f8d9f27975526604d/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:05.095990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:05.097299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:05.171462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 214/417] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:05.513980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:05.632654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc60f9-a1a1-4c20-9adf-45b46de8c248 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:05.685913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909793c-aade-40bd-8796-1d1e37bedbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:05.686941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909793c-aade-40bd-8796-1d1e37bedbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:05.687431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909793c-aade-40bd-8796-1d1e37bedbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:05.687899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909793c-aade-40bd-8796-1d1e37bedbb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:05.702089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909793c-aade-40bd-8796-1d1e37bedbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6909793c-aade-40bd-8796-1d1e37bedbb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:05.708620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:05.709588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:05.710415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:05.712700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 204/418] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:05.719453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:05.780031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:05.832952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fc04-a7ae-4f1a-aef9-6075029ddc2a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:05.833276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fc04-a7ae-4f1a-aef9-6075029ddc2a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:05.833523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6fc04-a7ae-4f1a-aef9-6075029ddc2a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:05.834834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 205/419] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:05.840382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895edc1-3534-4d8c-8daa-74e8ffd9249f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:05.840766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895edc1-3534-4d8c-8daa-74e8ffd9249f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:05.840999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895edc1-3534-4d8c-8daa-74e8ffd9249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:05.866005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1dff-f2c9-4abb-acab-0fdb7f8710ed None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:05.875197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a895edc1-3534-4d8c-8daa-74e8ffd9249f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:05.876565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a895edc1-3534-4d8c-8daa-74e8ffd9249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:05.887749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:05.902925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:05.904201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:05.904771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:05.904900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:05.905498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:05.905793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:05.907145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:05.916350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 215/420] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:47:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:05.924726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.006398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 206/421] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:06.071067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd207a-7620-449f-84ef-a921979e19fd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.071691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd207a-7620-449f-84ef-a921979e19fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.072191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd207a-7620-449f-84ef-a921979e19fd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.074062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 207/422] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:06.082438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.082438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.082438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.100514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:06.101705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:06.105359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:06.120282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c868f-57f3-4012-9805-7acb3f4b8474 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.183709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:06.184384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.185178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.185455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.206510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 208/423] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:06.302847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:06.304205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:06.379145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.448675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:06.469764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 216/424] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:47:06.481719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.491147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:06.530660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de66676-c0cb-48e5-849d-08c24955c2aa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.573473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:06.574836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.575401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.575889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.589134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:06.596698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:06.597626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:06.598534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:06.601299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 209/425] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:06.602519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.613392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c257a1-272d-4dd0-a61a-c708dd59ce6d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.661528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:06.662557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.662932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.663829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.665383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:06.667563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:06.669783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 217/426] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:06.671290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.730684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244192a-716c-4d27-9d49-8f78d8f61b47 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.745784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:06.766725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:06.771905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:06.772880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.777790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.777790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.786755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:06.792457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:06.793367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:06.794872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 210/427] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:06.800449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.804583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a5f38-078e-423e-a246-e85360362f93 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.847679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:06.848630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.849106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.849570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.850440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:06.850956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:06.852560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:06.862576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 218/428] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:06.863698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.940959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e3b08-a6bb-4189-af1a-86562096d073 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.971722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf98677-93c0-45a1-b118-02ddc3e2ceab None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:06.986498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:06.987137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:06.987429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:06.988065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:06.989527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:06.991393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:06.993641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 211/429] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:06.994482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:06.995502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.011205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.012177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.013533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.014024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.014893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:07.015432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.017201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.043037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 219/430] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:07.044648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.065472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.112415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645a270-0dfa-4ce3-8571-0b628b9df5ee None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.155479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49347c07-5c2d-4fe8-815d-393caf9aa0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.156410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347c07-5c2d-4fe8-815d-393caf9aa0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.156701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347c07-5c2d-4fe8-815d-393caf9aa0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.156978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347c07-5c2d-4fe8-815d-393caf9aa0c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.179578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48052a-206e-4742-955b-b9d8161122dd None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.216083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.217224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.217768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.218242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.219209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:07.219726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.221379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.228029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 220/431] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=35a5b624e6db4cad87cd57e909000815 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:07.229078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.250225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49347c07-5c2d-4fe8-815d-393caf9aa0c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.252335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49347c07-5c2d-4fe8-815d-393caf9aa0c5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.293401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.337600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.355904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2744b4-f014-4ba3-8a4c-48b47c3cc9b1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.396134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 212/432] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:07.401362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.401769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414d6c1-7099-48eb-b416-3731bdeebe66 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.402062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414d6c1-7099-48eb-b416-3731bdeebe66 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.402343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414d6c1-7099-48eb-b416-3731bdeebe66 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.402942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.403493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.404154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.404600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 213/433] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:07.405438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414d6c1-7099-48eb-b416-3731bdeebe66 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.494262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.495708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.539862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414d6c1-7099-48eb-b416-3731bdeebe66 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.560032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.579788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884535-22ae-41a4-9cb4-87387296ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.580470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884535-22ae-41a4-9cb4-87387296ad06 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.580751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884535-22ae-41a4-9cb4-87387296ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.581024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884535-22ae-41a4-9cb4-87387296ad06 None admin] PATH_INFO: `/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.582240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c884535-22ae-41a4-9cb4-87387296ad06 None admin] RBAC: Authorizing `identity:get_project(project_id=46954ca73fa842eeb4c3abc44e35f9fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.583741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c884535-22ae-41a4-9cb4-87387296ad06 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.585468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 214/434] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/projects/46954ca73fa842eeb4c3abc44e35f9fe => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:07.589457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.589457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.589457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.609463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:07.610657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:07.631927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 221/435] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:07.632839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.648046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.708177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 215/436] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:07.708177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.764643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a4bf3-cc19-43da-912e-2313a0d7d967 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.804274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.804947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.805220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.805491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.806608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.808027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.810083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 222/437] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:07.816050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.835855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.847973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71523b-e057-4c75-a443-e41f4a886e91 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.884921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c2c4c-42b4-490b-beff-a1b9fb4abefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.885550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2c4c-42b4-490b-beff-a1b9fb4abefb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.885835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2c4c-42b4-490b-beff-a1b9fb4abefb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.886104 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2c4c-42b4-490b-beff-a1b9fb4abefb None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.887195 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c2c4c-42b4-490b-beff-a1b9fb4abefb None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.889271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c2c4c-42b4-490b-beff-a1b9fb4abefb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.895548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 216/438] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:07.895548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25bf7-1a50-4c29-9157-46af894e90e3 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.895548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25bf7-1a50-4c29-9157-46af894e90e3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.895548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f25bf7-1a50-4c29-9157-46af894e90e3 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.895548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 217/439] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:07.896226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f25bf7-1a50-4c29-9157-46af894e90e3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:07.926030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:07.936010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92990a2-a0c7-4889-a0cc-c4f7c7b3da59 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:07.982406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:07.983008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.983284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.983569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:07.984287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:07.984617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:07.986024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9c69b-f061-44b6-9245-c9b9e4fc8fec None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:07.992170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 223/440] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=46954ca73fa842eeb4c3abc44e35f9fe&role.id=9efddb790ba641d59d0f165b116e2876 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:07.993152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:07.993433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:07.993697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.016094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f25bf7-1a50-4c29-9157-46af894e90e3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.020919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:08.022140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:08.070166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.070824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.071103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.071378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.073578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.076682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:08.078579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 218/441] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:07 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:08.081390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.116199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 224/442] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:08.117241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.129668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.199628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.207519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2f776-bab9-493f-bf89-d97e4d916176 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.241380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8615ad-cd56-437c-8565-40cd4add50d0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.252528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.253303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.253588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.253863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.266961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:08.272218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:08.273198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:08.274072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 219/443] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:08.279946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.288602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.289990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.290414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.290824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.292158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=35a5b624e6db4cad87cd57e909000815, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:08.292642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.294989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:08.302478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 225/444] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=35a5b624e6db4cad87cd57e909000815 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:08.397271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945aa7-d27e-412d-96bb-6bbd2e62be29 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.409111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.448301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.448959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.449245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.449522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.450837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:08.451116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.452579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:08.469849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 220/445] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:08.476579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.499578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.510074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.544509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc89b5-f98f-4bdf-81ab-35ec22f54a06 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.584347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.585050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.585163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.585896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.596659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:08.603221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24c99-0f30-49a1-949e-59dec8477827 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:08.603497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:08.604388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:08.605190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 226/446] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:08.610626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.647852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.648531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.648814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.649088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.730727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b70d9-6ebd-4f25-b959-cd916c220e82 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.736153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.737730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:08.756782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.762281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.767743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.768372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.768635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.768909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.769566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:08.769865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.771211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:08.779157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 227/447] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:08.784941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.841179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 221/448] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:08.846825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.888096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca95c-e296-49a0-8907-e79a795a2df1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.921392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.921995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.922272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.922543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.944263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9378b4-8037-497e-92c6-24d65ccfb6c7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:08.961315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.978602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:08.979222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:08.979496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:08.979765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] PATH_INFO: `/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:08.980933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2caddf9c1b4ea08235ed5e19f152ac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.982206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:08.983278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:08.985037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 222/449] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/projects/5f2caddf9c1b4ea08235ed5e19f152ac => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:08.990218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:08.990387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:08.991914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:09.091232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 228/450] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:09.091499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b1f2-4bbc-4af0-86cf-5ce5388187d7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:09.096952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:09.126408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:09.127040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:09.127317 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:09.127593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] PATH_INFO: `/v3/groups/064968f04af94b108f2014cf28793ed5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:09.128798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] RBAC: Authorizing `identity:get_group(group_id=064968f04af94b108f2014cf28793ed5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:09.130235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:09.131789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 223/451] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:08 2022] GET /identity/v3/groups/064968f04af94b108f2014cf28793ed5 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:09.137397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:09.187026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:09.188833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:09.193381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d25561-b089-4816-a470-2779f33c15bd None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:09.226309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:09.226933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:09.227208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:09.227480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] PATH_INFO: `/v3/projects/fcc2355d0a64457f8c16a6298a1d7815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:09.228616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] RBAC: Authorizing `identity:get_project(project_id=fcc2355d0a64457f8c16a6298a1d7815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:09.230037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:09.231852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 229/452] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:47:09 2022] GET /identity/v3/projects/fcc2355d0a64457f8c16a6298a1d7815 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:09.233918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405e81-49c4-4a44-a6e3-66f824b0f7e8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:09.237291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:09.266642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:09.267243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:09.267520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:09.267788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:09.268532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] RBAC: Adding query filter params (group.id=064968f04af94b108f2014cf28793ed5, role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:09.268833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:09.270340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:09.276283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 224/453] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:47:09 2022] GET /identity/v3/role_assignments?group.id=064968f04af94b108f2014cf28793ed5&scope.project.id=5f2caddf9c1b4ea08235ed5e19f152ac&role.id=9efddb790ba641d59d0f165b116e2876 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:09.339269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e182f1e-2c95-4541-b950-f08bfd780d39 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:09.375382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b619-96b5-49b4-8747-c9b766591c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:09.376014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b619-96b5-49b4-8747-c9b766591c82 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:09.376287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b619-96b5-49b4-8747-c9b766591c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:09.376584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b619-96b5-49b4-8747-c9b766591c82 None admin] PATH_INFO: `/v3/groups/153da63b69f1424f8d9f27975526604d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:09.377721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b619-96b5-49b4-8747-c9b766591c82 None admin] RBAC: Authorizing `identity:get_group(group_id=153da63b69f1424f8d9f27975526604d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:09.379145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7b619-96b5-49b4-8747-c9b766591c82 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:09.380758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 230/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Sep 15 10:47:09 2022] GET /identity/v3/groups/153da63b69f1424f8d9f27975526604d => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:09.386849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:09.489467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7acf1-766b-43f9-a4e4-fb832987b325 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:09.506911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:09.525561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:09.526168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:09.526450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:09.526724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:09.527448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] RBAC: Adding query filter params (group.id=153da63b69f1424f8d9f27975526604d, role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=fcc2355d0a64457f8c16a6298a1d7815) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:09.527750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:09.529658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60eea4-0180-4b23-9f5e-fdcaa0cd40f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:09.535583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 225/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Sep 15 10:47:09 2022] GET /identity/v3/role_assignments?group.id=153da63b69f1424f8d9f27975526604d&scope.project.id=fcc2355d0a64457f8c16a6298a1d7815&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:12.304424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f22ac7-72bd-49fe-8c92-f6ddf14c27d9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.304937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f22ac7-72bd-49fe-8c92-f6ddf14c27d9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.304937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f22ac7-72bd-49fe-8c92-f6ddf14c27d9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.306606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 231/456] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:12.312784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7624-e5ea-4d6a-b9f6-3f939ad273eb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.313392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7624-e5ea-4d6a-b9f6-3f939ad273eb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.313392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7624-e5ea-4d6a-b9f6-3f939ad273eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.337064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-295b7624-e5ea-4d6a-b9f6-3f939ad273eb None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:12.338262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-295b7624-e5ea-4d6a-b9f6-3f939ad273eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:12.436254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 226/457] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:12.521476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aac93-feac-4557-8ec8-247db1d5853d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.521796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aac93-feac-4557-8ec8-247db1d5853d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.522030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aac93-feac-4557-8ec8-247db1d5853d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.523360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 232/458] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:12.529749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fdec0-af89-47c3-b160-b6e812775b07 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.530046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fdec0-af89-47c3-b160-b6e812775b07 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.530324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fdec0-af89-47c3-b160-b6e812775b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.556600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2d1fdec0-af89-47c3-b160-b6e812775b07 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:12.557700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2d1fdec0-af89-47c3-b160-b6e812775b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:12.654822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 227/459] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:12.678104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d5c4f-cc5d-4b6d-a643-b9d0daea3af3 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.678385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d5c4f-cc5d-4b6d-a643-b9d0daea3af3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.678660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d5c4f-cc5d-4b6d-a643-b9d0daea3af3 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.679983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 233/460] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:12.685820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ca42-18d5-45d7-8905-ae8b9f213b18 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.686107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ca42-18d5-45d7-8905-ae8b9f213b18 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.686387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219ca42-18d5-45d7-8905-ae8b9f213b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.714342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5219ca42-18d5-45d7-8905-ae8b9f213b18 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:12.716804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5219ca42-18d5-45d7-8905-ae8b9f213b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:12.759122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:12.819269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 228/461] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:12.831546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d5c4f-cc5d-4b6d-a643-b9d0daea3af3 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:12.877094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:12.929644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4169-bc97-4131-8d51-e90b57c8d43c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.930623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4169-bc97-4131-8d51-e90b57c8d43c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.931103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e4169-bc97-4131-8d51-e90b57c8d43c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.933493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 229/462] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:12.941541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:12.941823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:12.942100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:12.974556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:12.975734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:12.976865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d5c4f-cc5d-4b6d-a643-b9d0daea3af3 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.024877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.025801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.026084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.031308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.041223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.043027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.060728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 230/463] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:13.061563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:13.062250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:13.063148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:13.064023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:13.064023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.064023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:13.066122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 234/464] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:13.072218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.169686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:13.177769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c65593-2f38-41c3-a2b2-27fa83f7bbc8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.186972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:13.223925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd80c-5112-47a6-8397-5abeb417dfc9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.239683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.240346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.240950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.241241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.252569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.254024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.264574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.265565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.265949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.266317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.267089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:13.267481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.268965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:13.270570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:13.271629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:13.272566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:13.272566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.272566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:13.272566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 231/465] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:13.272779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.288419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 235/466] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:13.289768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.398779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66cd42-cd46-403d-9c76-82be5973d48f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.410789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7267080-3f77-4c66-ab86-9344ae0d0291 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.440246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.440904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.441180 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.441502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.449305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.449934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.450210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.450520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.451236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:13.451634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.452454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.452969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.453936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.468446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 236/467] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:13.468446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:13.469919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:13.470928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:13.471999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:13.471999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.471999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:13.471999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 232/468] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:13.472274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.474204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:13.480245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:13.581760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246412-86a6-4ee4-b3ff-bd76abb4c097 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.590081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc22d9-513f-48d1-bd1d-4de248ca77be None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.618421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.619028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.619311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.619588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.620247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.621800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.625866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.626522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.626795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.627061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.640320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.641873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:13.659058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:13.660333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:13.661204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:13.661204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:13.661204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:13.661204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 233/469] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:13.661431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.721127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:13.723749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 237/470] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:47:13 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:13.724702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.784645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ece71-ccd8-488f-92e3-78ba16d81131 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.796680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:13.824657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.825908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.826342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.826641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.827279 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.828781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.847865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76342-a428-4a81-a6bc-f0429f40fcc7 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:13.884919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:13.885527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.885804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.886074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.886815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:13.887044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:13.889173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0090c88-cefa-4550-9f1e-665a03e48f3a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:13.900334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 234/471] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:47:13 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:13.900334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:13.905857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 238/472] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:13.907166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813789f-3c92-43d4-bad0-486f2339a396 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:13.907449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813789f-3c92-43d4-bad0-486f2339a396 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:13.907718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813789f-3c92-43d4-bad0-486f2339a396 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:13.909177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 239/473] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:13.913370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813789f-3c92-43d4-bad0-486f2339a396 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:14.038301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891fad6-cf51-4919-8173-3dcfb0e02182 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:14.054039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:14.058115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813789f-3c92-43d4-bad0-486f2339a396 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:14.080729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:14.094277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:14.095047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:14.095334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:14.095930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:14.096783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:14.097091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:14.098709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4a8c4-7baf-49af-afa1-c508d3a899a8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:14.101419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:14.102123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:14.102410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:14.102690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:14.103348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:14.104798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:14.124616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 235/474] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:14.126221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:14.126854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:14.127312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:14.147295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:14.148239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:14.212432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 240/475] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:47:13 2022] POST /identity/v3/users => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:14.212432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:14.234769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 236/476] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:14.362189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cd21d-a772-40e5-a6d2-baedd91fa75b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:14.401187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:14.402156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:14.402634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:14.403701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:14.404600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:14.406261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:14.536620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 241/477] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:47:14 2022] POST /identity/v3/users => generated 249 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:14.633372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:14.741322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7146f-5d55-475d-8571-6c311c49e2d9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:14.742882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:14.779191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:14.779823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:14.780104 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:14.780414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:14.781126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:14.782579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:14.833922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.sql.core [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 10:47:14.833922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 10:47:14.833922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [parameters: {'id': '1ef265f92a464284910f115b112b2f9a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 10:47:14.833922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81564) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application conn.query(q) Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result.read() Sep 15 10:47:14.851614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 10:47:14.852711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application next(self.gen) Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application yield resource Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application next(self.gen) Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise self.value Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application session.commit() Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 10:47:14.853679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.session.flush() Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application compat.raise_( Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 10:47:14.855585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 10:47:14.857950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application conn.query(q) Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result.read() Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 10:47:14.859923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [parameters: {'id': '1ef265f92a464284910f115b112b2f9a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:14.861903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 10:47:14.866683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:14.869357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 237/478] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 15 10:47:14 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:14.869510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:14.907374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:14.983628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05948e6b-48bd-4e24-b906-c30fff5ef136 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:15.024059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b208ffd-12dd-4ea9-929f-d9a9fed5c1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:15.024710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208ffd-12dd-4ea9-929f-d9a9fed5c1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:15.024991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208ffd-12dd-4ea9-929f-d9a9fed5c1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:15.025261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b208ffd-12dd-4ea9-929f-d9a9fed5c1a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:15.048340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b208ffd-12dd-4ea9-929f-d9a9fed5c1a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9b208ffd-12dd-4ea9-929f-d9a9fed5c1a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:15.049709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:15.050614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:15.051414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 242/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:15.056593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:15.174246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24446978-7798-4351-80f0-cd73c67797ac None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:15.209295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:15.209900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:15.210176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:15.210449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:15.211114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:15.211411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:15.212813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3fb63-25ef-4703-b076-0e69522ac866 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:15.221887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 238/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:16.557044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1c001-7720-406e-8245-bbfb1af55f7b None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:16.557566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1c001-7720-406e-8245-bbfb1af55f7b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:16.557566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1c001-7720-406e-8245-bbfb1af55f7b None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:16.559278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 243/481] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:16.564396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771fce-41d2-48fb-8f12-cd33cda1da9a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:16.564824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771fce-41d2-48fb-8f12-cd33cda1da9a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:16.564990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771fce-41d2-48fb-8f12-cd33cda1da9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:16.587732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f0771fce-41d2-48fb-8f12-cd33cda1da9a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:16.589007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f0771fce-41d2-48fb-8f12-cd33cda1da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:16.613551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:16.660531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 239/482] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:16.661782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe8da-cdff-4076-a94e-de620a598619 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:16.662140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe8da-cdff-4076-a94e-de620a598619 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:16.662503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe8da-cdff-4076-a94e-de620a598619 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:16.664148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 244/483] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:16.670519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c450a-6f86-41c1-b244-c51ea1f0ed1e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:16.671164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c450a-6f86-41c1-b244-c51ea1f0ed1e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:16.679705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c450a-6f86-41c1-b244-c51ea1f0ed1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:16.692020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6e7c450a-6f86-41c1-b244-c51ea1f0ed1e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:16.693587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6e7c450a-6f86-41c1-b244-c51ea1f0ed1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:16.765767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 240/484] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:16.827659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cabfd-2505-41fc-87b9-bd7363cdb553 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:16.828200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cabfd-2505-41fc-87b9-bd7363cdb553 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:16.828670 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cabfd-2505-41fc-87b9-bd7363cdb553 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:16.830172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 245/485] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:16.835711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:16.836215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:16.836683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:16.855785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:16.857342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:16.927940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 241/486] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:16.944131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cabfd-2505-41fc-87b9-bd7363cdb553 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.079083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.089658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cabfd-2505-41fc-87b9-bd7363cdb553 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.136871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.138381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.138838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.139285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.149894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:17.157460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:17.158353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:17.159192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:17.165227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 246/487] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:17.171538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.200826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.236483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.299394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15868e6a-6de2-4087-8e83-08f7fc487790 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.337174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.337711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.337990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.338265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.338980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:17.339246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:17.340734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:17.350112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 242/488] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:17.351307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.363756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c729f-2cd2-4dd2-b652-2b6dc5b19d4f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.400872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.401895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.402384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.403559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.414666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:17.420475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:17.421359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:17.422166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:17.428424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 247/489] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:17.429486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.437508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.445204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.456246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2289e-4612-4531-89a6-cd3880a7092c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.495263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.496058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.497172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.497639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.511055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:17.517187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:17.518118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:17.518919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 243/490] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:17.519707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.542967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73181ba-f764-40f4-8fb8-635d3a260e8d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.578684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.579314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.579575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.579844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.591989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:17.593412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-202f996d-56f8-4847-b5de-ff08fc6f0d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:17.610691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:17.611620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:17.613120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:17.613120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:17.613120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:17.613120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 248/491] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:17.613120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04dd4a-12f1-4a84-8af0-935cd3526f9c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.613412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04dd4a-12f1-4a84-8af0-935cd3526f9c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.613478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04dd4a-12f1-4a84-8af0-935cd3526f9c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.619349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 249/492] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:17.619349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04dd4a-12f1-4a84-8af0-935cd3526f9c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.640897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6101-e034-4015-89d0-13dfb01f7ad1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.678388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.678989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.679268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.679543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.679901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.680990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:17.681290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:17.682668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:17.696768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 244/493] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:17.696768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.699468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.720328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04dd4a-12f1-4a84-8af0-935cd3526f9c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.756449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.757050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.757328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.757601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.758256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:17.758556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:17.759897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226200e2-f2d3-482b-bd0b-189f63edd71a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:17.768134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 250/494] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:17.769341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.769619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.769887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.788336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:17.789503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:17.827998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980af8-1e0f-46d4-9c66-bb0bfcc2fb4a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.862512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 251/495] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:17.863238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.870939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:17.872814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:17.873756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:17.874267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:17.875510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:17.876345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:17.878240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:17.896754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 245/496] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:17.898161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:17.924047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:17.972224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c792d-8bba-44df-abe4-510955e66216 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:17.983041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.013259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.013979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.014336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.014653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.026541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.028465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.035835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d3c4e-b12f-4246-acd9-5de6d9d20eb5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:18.047957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:18.048874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:18.049744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:18.049744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:18.049744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:18.049744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 252/497] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:18.049744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.090323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.091792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.092218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.092656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.103582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.105253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:18.123379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:18.124535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:18.125582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:18.125582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:18.125582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:18.127327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 246/498] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:18.128255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.178578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7ba60-4c7a-4ee2-ab3c-967539b5ad87 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.186965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.213177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.213857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.214327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.215066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.222664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.224082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.235402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a63d9d-f150-4074-8039-8b24a9cddffe None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:18.236585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:18.237622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 253/499] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:18.238529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.252250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.272076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.272689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.272973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.273252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.273892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:18.274197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.275634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.288126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 247/500] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:18.288958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.337129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac2ba3-af2b-41a2-85dc-df02964ed5f0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.370565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.371164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.371626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.371977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.372744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:18.373045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.374448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68abd-eb82-4a4d-851f-e66091f81aab None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.385617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 254/501] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:18.386883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793718-0cd5-4851-92cb-a83f546841f5 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.387223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793718-0cd5-4851-92cb-a83f546841f5 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.387755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af793718-0cd5-4851-92cb-a83f546841f5 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.389106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 255/502] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:18.389652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793718-0cd5-4851-92cb-a83f546841f5 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.391576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b930710-06fd-43b3-9eb7-bb68f10559d1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.421939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.427773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.428436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.428723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.429000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.439028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:18.443848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:18.450578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 248/503] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:18.451369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.482777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.495223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af793718-0cd5-4851-92cb-a83f546841f5 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.538826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.539487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.539767 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.540043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.540822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:18.541130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.542557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.551663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f3397-7920-480e-94a3-726f48844610 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.580162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 256/504] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:18.581130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.585576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.586199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.586482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.586867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.595384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.597101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-afd10b32-7b0b-4c10-b690-ceea9c1772a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:18.611832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:18.612934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:18.614110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 249/505] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:18.614803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.614803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.614803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.632394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:18.633523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:18.670140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.685908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473e544-0f96-479d-949c-2e6ad7695db1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.698244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 250/506] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:18.699080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.723856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.737890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.738649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.739000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.739351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.749530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.751256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:18.767294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:18.774581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 257/507] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:18.775518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.801212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574c028-fe78-4dcf-b173-765703e03cc1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.890814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.891336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.891620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.891903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.892892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:18.893193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:18.894538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:18.902633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 251/508] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:18.904066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:18.932920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84678fbf-a8a1-4e22-b197-2023cab16f47 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:18.972859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:18.973464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:18.973741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:18.974014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:18.988973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:18.994872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.009276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2e33-18a9-43ac-8e03-face950ce217 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.043068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.043782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.043892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.044086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.044388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.045113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:19.045264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.045416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.046834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.083825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 252/509] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:19.084701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.143041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 258/510] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:19.143786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.183351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec95ebe-2504-4795-87ba-66b04cd1241c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.187295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.221447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.222077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.222359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.222636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.223365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:19.223671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.225144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.242017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c94590-029d-4e64-86a6-95fc14cc71da None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.242776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 253/511] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:19.243567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.246166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.276776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.277361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.278192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.278477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.288152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.289631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:19.304278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:19.305400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:19.306260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:19.306260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:19.306260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:19.306260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 259/512] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:19.306260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.345006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce5142-435c-4586-b845-446ce029cd7b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.378496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.379239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.379584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.379944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.390527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.391980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.399063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.404897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356c333-b3dc-44f8-9c38-b0e09e708bd4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:19.408512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:19.409373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:19.410227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:19.410227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:19.410227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:19.410227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 254/513] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:19.410227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.439480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.440094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.440439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.440757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.466506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.510289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.511009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91b65-ae8f-43e0-bd1a-c7905c78d2c6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.511769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.544935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.545568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.545851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.546134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.556622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.558074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:19.572693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:19.573793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:19.575257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:19.575257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:19.575257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:19.575257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 255/514] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:19.575696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.607436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.613512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 260/515] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:19.614312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.673774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499818f-071e-4542-90c7-33466de5a720 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.680544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.707483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.708102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.708375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.708649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.713611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54756326-aff5-4e06-95a0-86611828c4d7 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.747586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.748188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.748527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.748805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.749711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:19.749711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.751080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.761905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 261/516] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:19.762742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.779840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.781400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.821718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.866556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bef94-7186-4bf1-a1ca-b8ca0bc9c1df None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:19.883941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 256/517] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:19.883941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.887959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:19.906175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:19.906769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:19.907079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:19.907385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:19.908019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:19.908349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:19.909737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:19.923472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 262/518] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:19.924436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:19.980226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa14d-f923-4aa0-9fd3-909280dde78a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.014073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.014670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.014951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.015228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.015863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:20.016168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.017568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.020527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244832ec-e9ed-4081-b84e-7a9b65b5e928 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.030011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 257/519] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:20.030309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.040074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.057699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.058417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.058700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.058998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.068966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.070707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:20.085174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:20.086233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:20.087287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:20.087287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:20.087287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:20.087287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 263/520] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:20.087287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.099904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.135395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabaf3-977d-4ee2-91cd-0ff989aef059 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.173022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.173652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.173929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.174201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.181733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.183099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.192296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f39f6-4ca0-465c-a90f-df8ee3ff05f4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:20.193929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:20.194913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 258/521] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:20.195950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.229741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.230524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.231397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.231789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.242673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.244115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:20.259720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:20.260881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:20.263162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:20.263162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:20.263162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:20.263162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 264/522] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:20.263162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.283951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.306873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97782-0095-47cb-b0a1-6405fa5a4dd2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.332541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.341733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.342339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.342618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.342900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.343541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.345010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.359641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8b25b-37a7-47c5-bbc6-5485756c5a8d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.392227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.392876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.393158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.393435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.399830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.401281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:20.413421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:20.420161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 265/523] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:20.421226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.436002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 259/524] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:47:20 2022] POST /identity/v3/users => generated 247 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:20.437051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.519558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.552266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb6a0d-1c92-4c92-888a-7623ad463ca3 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.557086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac632e-1cc0-4e81-8574-fde0f81edf0d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.591930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.592585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.592857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.593175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.593781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:20.594087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.594304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.594919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.595197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.595464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.595563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.596203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:20.596532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.597962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.610113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 266/525] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:20.610113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.618090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 260/526] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:20.618405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.671050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.725191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4b601-b96b-428e-ab15-eba26f7b3a6d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.730144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923bdb7-907a-42af-8b55-886db83a783c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.762809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.763536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.763837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.764092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.764770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:20.765071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.767237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.771593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.772198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.772530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.772801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.773495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:20.773797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.775224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.776531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.785012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 267/527] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:20.785012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.795156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 261/528] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:20.796185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:20.899137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf06e-9744-4191-a325-1c1c39138aed None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.904641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:20.908143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13403948-f9a8-4dc9-9485-5fad19f3e776 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:20.935912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.936580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.936870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.937137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.944148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:20.945600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:20.945813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:20.946428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:20.946713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:20.946993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:20.958211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:20.959102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:20.959941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 268/529] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:20.960833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.022047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.023425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.029398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.075158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d09a2-9322-455f-afad-88c6b83957df None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.111029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.111651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.111933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.112210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.119677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.121134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.132606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:21.133766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:21.134597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:21.135444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 269/530] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:21.135918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.141529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 262/531] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:21.142365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.247795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619beddb-6422-4e09-8c55-d8003ec90704 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.250750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd6fda-0580-44dd-b70c-5cb88a07e521 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.271833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.284629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.285169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.285449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.285723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.286413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:21.286725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.287334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.288001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.288180 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.288375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.288656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.289377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=e538cfa7711a4ebf8868138f8520018a) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:21.289694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.291080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.308591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 270/532] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/role_assignments?user.id=e538cfa7711a4ebf8868138f8520018a&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:21.308591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.313765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 263/533] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:21.315049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.399920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.436050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306957e1-fc45-4e08-9f42-d0f2cc8409fa None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.458806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2091f-c399-4139-9db4-bb64d33dfbd4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.476399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.477020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.477301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.477576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.478386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:21.478698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.480265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.501264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 271/534] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:21.502433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.511049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.511687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.511993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.512345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.525140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.526855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:21.542831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:21.543848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:21.544831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:21.544831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:21.544831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:21.548624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 264/535] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:21.549493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.560424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.623618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9931f-67fb-4670-a748-83e1afc5bf6c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.659192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.659798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.660074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.660377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.661253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=1d237fc491984323aa81865c59d71771) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:21.661562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.663083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.676359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 272/536] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/role_assignments?user.id=1d237fc491984323aa81865c59d71771&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:21.676359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:21.713095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062163c5-8d95-45fb-86d1-312905e65f42 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.740421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.788145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.788788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.789066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.789339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.790088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=3c2b03530d554c27b1dc3282a5063df4) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:21.790397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.791896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.804677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 265/537] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/role_assignments?user.id=3c2b03530d554c27b1dc3282a5063df4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:21.858611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc8bf8-59f6-4df8-8eb2-9f2354f01cd7 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:21.869106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:21.911130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:21.911757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:21.912086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:21.912401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:21.913065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:21.913368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:21.914796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:21.928669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 273/538] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:21.933863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:22.078487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b38cf-98cb-4e36-bd91-d0543913431c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:22.115009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:22.115633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:22.116178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:22.116481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:22.129818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:22.131331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:22.148907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:22.149834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:22.150685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 266/539] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:22.156824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:22.320560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a21cd-3815-4737-8b3f-c1c0731a5d07 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:22.390276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:22.390893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:22.391171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:22.391441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:22.392132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:22.392453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:22.393859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dabc0b-beb5-479e-90e1-253cf008a88f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:22.410166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 274/540] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:22.415916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:22.452963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:22.536260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ca96-8210-46db-af80-1d29fda22fe2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:22.585576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:22.586193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:22.586477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:22.586747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:22.587489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=f259e1d9dd2d47e4af4d4dcdc93eaef8) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:22.587805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:22.589300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39058a47-7e58-4d88-94d3-b945f7f2e86c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:22.595911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 267/541] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:22 2022] GET /identity/v3/role_assignments?user.id=f259e1d9dd2d47e4af4d4dcdc93eaef8&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:22.908031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d2bf-75fc-427e-8e07-5f95d7bc672c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:22.908597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d2bf-75fc-427e-8e07-5f95d7bc672c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:22.908597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d2bf-75fc-427e-8e07-5f95d7bc672c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:22.910199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 275/542] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:22.925919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:22.926509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:22.926509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:22.950213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:22.951491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:23.030391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 268/543] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:23.310379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d2bf-75fc-427e-8e07-5f95d7bc672c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:23.345290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:23.440341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d2bf-75fc-427e-8e07-5f95d7bc672c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:23.485529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:23.486527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:23.487029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:23.487499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:23.507530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:23.514213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:23.515097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:23.515900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:23.518152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 276/544] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:23.529403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:23.576348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:23.680123 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134661-2262-472d-9b52-ba478eddfe42 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:23.727019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:23.727656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:23.727940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:23.728215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:23.728944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:23.729253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:23.730754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415efac4-a212-4104-ad58-8e55790dffee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:23.740582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 269/545] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:23.746253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:23.920437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:23.940110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd4c5b-0a32-4b1f-8636-1a424c26e32e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:23.976087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:23.977123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:23.977607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:23.978077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:23.994203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:23.995938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:24.005843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08916-32a4-4b70-aa42-d9569943b1e4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.006343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08916-32a4-4b70-aa42-d9569943b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.006420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08916-32a4-4b70-aa42-d9569943b1e4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.007885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 270/546] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:24.013888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.014174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.014455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:24.017350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:24.018292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:24.019123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:24.019123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:24.019123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:24.021630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 277/547] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:24.029707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:24.070533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:24.071750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:24.140385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6a056-e639-4b12-be2c-e6fe040fbea3 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:24.190482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:24.191085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.191366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.191641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.192332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:24.192648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:24.194032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:24.210088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:24.215283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 278/548] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:24.221086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:24.237668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 271/549] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 15 10:47:24.346549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663439b-89a5-4a6d-9bbd-4c1c50ce8684 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:24.388034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:24.388976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.389421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.389843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.398725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:24.400471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-1c665066-3cf3-447f-aff3-a77c604e2d79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:24.417496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:24.418890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:24.419932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:24.426410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 279/550] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:24.433409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:24.486646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:24.517276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8d36-72b4-49b3-92e8-1649aa6940d6 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.517918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8d36-72b4-49b3-92e8-1649aa6940d6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.518404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f8d36-72b4-49b3-92e8-1649aa6940d6 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.520162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 280/551] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:24.531836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a5a4-d67b-4361-bcbd-299f1d925ae7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.532560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a5a4-d67b-4361-bcbd-299f1d925ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.533043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a5a4-d67b-4361-bcbd-299f1d925ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.563407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6622a5a4-d67b-4361-bcbd-299f1d925ae7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:24.565118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6622a5a4-d67b-4361-bcbd-299f1d925ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:24.593047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2e22a-ab80-4431-82fb-79797c20747a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:24.630092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:24.638727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:24.644053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.644053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.644053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.644053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:24.644053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:24.644417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 281/552] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:24.644491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1bfb-0475-4353-b210-aa79b574ed6c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:24.644558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2816d-cd69-4321-88aa-176e0d3c94b0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.644558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2816d-cd69-4321-88aa-176e0d3c94b0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.644558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2816d-cd69-4321-88aa-176e0d3c94b0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.649466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 282/553] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:24.651337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2816d-cd69-4321-88aa-176e0d3c94b0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:24.663132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 272/554] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 15 10:47:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:24.664831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.665125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.665404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.690509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:24.694281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:24.778456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2816d-cd69-4321-88aa-176e0d3c94b0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:24.788460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 273/555] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:24.789387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:24.815143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:24.846635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:24.847344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:24.847622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:24.847894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:24.871296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:24.880521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:24.882672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:24.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 283/556] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:24.892349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:24.946310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:24.979890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9282de-d9ed-40f7-8f02-d5cba0f5c4b9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.012198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a86b-cd58-46ec-a676-d33787bc539c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.016590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.017206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.017491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.017832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.055027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.055637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.055915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.056192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.057038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:25.057354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.059381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.073001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 284/557] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:25.073875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.103280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.105464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.120037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.180434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244b45-a765-4c62-b041-b329c1b95c5c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.196813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.214779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 274/558] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:25.215930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.219622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.220463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.220910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.221381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.233146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:25.238924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:25.240029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:25.241335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:25.243747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 285/559] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:25.244670 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.333486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a923d36-036b-4a54-9adf-a37bd376ee67 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.344864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.369386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.370015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.370188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa83f2-fe79-4795-a212-8df6893ce175 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.370291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.370558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.381421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.382891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:25.397823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:25.398974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:25.399857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:25.399857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:25.399857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:25.399857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 275/560] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:25.400098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.411254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.411882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.412165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.412480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.422955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:25.428132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:25.429119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:25.429980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 286/561] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:25.431724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.462859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.503157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d675595-52a7-497e-b482-2bbd5210c97f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.530640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd60e88-346c-4a64-9055-12b87fd8ca6b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.535809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.536470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.536755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.537032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.547870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.549409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.566531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.567134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.567406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.567673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.568347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:25.568585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:25.569616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:25.570543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:25.570543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:25.570543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:25.570713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 276/562] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:25.571212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.575919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d9aa-2860-4d84-b398-ad626ea00463 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.584432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 287/563] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:25.585549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae51e2-724e-46e4-a294-4f02947ecf66 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.585830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae51e2-724e-46e4-a294-4f02947ecf66 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.586103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae51e2-724e-46e4-a294-4f02947ecf66 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.587274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 288/564] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:25.587950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae51e2-724e-46e4-a294-4f02947ecf66 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.592820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.676703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbff219-3eb8-4608-bc99-d2ebd879fe67 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.679356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.687180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae51e2-724e-46e4-a294-4f02947ecf66 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.709875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.710470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.710745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.711014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.711644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:25.711946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.713347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.720597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.721201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.721485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.721761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.722419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:25.722725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.724057 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.725936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 277/565] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:25.726724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.733040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 289/566] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:25.733976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.802982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.827765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110ac38-6d21-4fbd-9e5c-91e1b85e4f4b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.832743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4702b-969d-4cc2-ad05-9b618103a042 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:25.863816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.864447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.864728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.864999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.865636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:25.866200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.867555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a2ba6-922f-4995-9fe9-eb0f91a86c42 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.868013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:25.868665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.868949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.869225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.878848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 278/567] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:25.879736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:25.880132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:25.880442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:25.880718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:25.881200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:25.895978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:25.897008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:25.897900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:25.897900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:25.897900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:25.897900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 290/568] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:25.897900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:25.899170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:25.900434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:25.909102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:25.967979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 279/569] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:25.968666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.002692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a4fa-981f-4796-aa2b-7b0f71593401 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.042405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.046043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.046665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.046943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.047227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.054937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.056529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:26.067929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.068982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:47:26.069953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:26.076488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 291/570] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.076488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.081738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132728a3-b42e-486a-b9fa-e5e3fbbccfc7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.118559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.119666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.120105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.120581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.131331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.132996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.142582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:26.149011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.149945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:26.150918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:26.150918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:26.150918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:26.150918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 280/571] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.151165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.185716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71e956-a850-485a-ab84-44dd0a81f14c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.225573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.226211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.226493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.227196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.235624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.237627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:26.251218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.252129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 292/572] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.253327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.266785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9d36-a79a-41c5-9609-30834388c39f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.282837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.300210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.300836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.301111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.301389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.302021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:26.302325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.303670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.314891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 281/573] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:26.315673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.352291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0593-9dc9-4408-96b9-14f7589dac13 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.378725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.386628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.393502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.393502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.393502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.393502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:26.393502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.393502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.408375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 293/574] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:26.409181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.415611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411ea5e-c737-4246-8012-befce4cfbbc9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.448941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.450050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.450394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.450671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.451304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:26.451605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.453002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.463723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 282/575] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:26.464533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.500878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.505720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199486c6-e1b5-48fb-b5f7-2e3994cc9128 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.539874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.540531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.540820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.541088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.551562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:26.556351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.557300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:26.558137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 294/576] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.559382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.567332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412752ba-c44a-40be-9a8e-8caff39f5f36 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.600468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.601069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.601358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.601631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.602318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:26.602632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.603565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.604045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.616285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 283/577] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:26.616956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.656399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830b18-9730-457e-ab54-1dc7b101a0d5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.689415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.690034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.690317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.690593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.698154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.700153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:26.711139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.712104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 295/578] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.713109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.718523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.724443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1e34-eb05-4474-af1f-215bac96792e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.758967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.759897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.760188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.760572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.771430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.772922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:26.787271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.788276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:26.789216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:26.789216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:26.789216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:26.789216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 284/579] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.789446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.816007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641c99-b6e2-4c72-9dce-1a28f1ded1c9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.822780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.850288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.850913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.851192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.851463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.860082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.861546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:26.873072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:26.874064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 296/580] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:26.875041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.893419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce522c-fdc6-4d92-9eb1-968243c42b50 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:26.927339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:26.927872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:26.928150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:26.928462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:26.929159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:26.929462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:26.930819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:26.939025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 285/581] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:26.939868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:26.953059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:26.974643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8903-bcf4-473a-b7a3-f4df4ec5ec00 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.007788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.008438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.008693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.008968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.009687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=8107c052569f41c3a0d7f188d1642f4d) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.009992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.011392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.017129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 297/582] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/role_assignments?user.id=8107c052569f41c3a0d7f188d1642f4d&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.017978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.055435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a3da-1bf8-4983-b75c-8dc7912be1e6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.056147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.094696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.095319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.095605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.095884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.096671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.096980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.098478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.123381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 286/583] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:47:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.123381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.143792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508c92-2284-46f7-bc39-9e1dce4a8af5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.184081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.184791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.185075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.185355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.186005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.186844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.187693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.194606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.202984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 298/584] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.204337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.230868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa08d-218a-4842-9d21-7b0befba925b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.267804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.268445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.268742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.269017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.269776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.270085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.271507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.294960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 287/585] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.294960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.311690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.321731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac3a6d-b83d-432a-8f86-84653b32b6ba None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.357603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.358231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.358506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.358926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.369597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.371032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:27.386206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:27.387322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:27.388252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:27.388252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:27.388252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:27.388252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 299/586] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:27.388252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.398472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1d86-40fb-48db-ba11-d91560fba48c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.426450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.442895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.442895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.442895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.442895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.447643 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.449138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:27.465444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:27.466636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:27.467727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:27.467727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:27.467727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:27.471507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 288/587] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:27.472372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.498318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395e4c-3db1-4505-8cad-9c0e86a256eb None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.534194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.534824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.535105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.535380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.542216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.543960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:27.555887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:27.556900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 300/588] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:27.557772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.561983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.584600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe3ed7-f1da-4754-ab01-f94831f0c73a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.618369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.618994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.619272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.619542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.630700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.632710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:27.648254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:27.649231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:27.650116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:27.650116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:27.650116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:27.650116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 289/589] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:27.650968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.671963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13399e7-cf82-4bc8-b912-7516bb493445 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.682037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.709236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882787b-8e80-419b-9726-011e011886ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.709716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882787b-8e80-419b-9726-011e011886ef None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.709996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882787b-8e80-419b-9726-011e011886ef None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.710274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882787b-8e80-419b-9726-011e011886ef None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.710905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882787b-8e80-419b-9726-011e011886ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.711268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882787b-8e80-419b-9726-011e011886ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.712656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882787b-8e80-419b-9726-011e011886ef None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.730106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 301/590] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.730106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882787b-8e80-419b-9726-011e011886ef None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.764165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f70c6-a82e-45ec-ab04-1caf14dd1a7b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.795049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.803742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.804459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.806471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.806471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.806471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.806471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.807206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.819511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 290/591] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.820635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.840558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882787b-8e80-419b-9726-011e011886ef None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.879335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.880525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.880802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.881199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.881789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.882097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.885129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.899590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 302/592] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.900476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:27.931038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:27.940974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dea069-d952-45a8-b54f-2964b882faff None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:27.975953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:27.976560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:27.976805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:27.977459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:27.979077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:27.979077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:27.980869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:27.996570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 291/593] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:27.996570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.018953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d0b53-50bf-4472-811b-9db4acc06513 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.049925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:28.062395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.063032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.063308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.063579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.071347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.072801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:28.084348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:28.085270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 303/594] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:28.086191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.109198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a2619-86f1-45d9-ac4d-9e9b4b6d79b5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.144534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.145153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.145432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.145704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.152122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.154150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:28.169221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:28.170286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:28.171291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 292/595] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:28.171770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.184963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:28.197587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba90d-7f58-44f6-af21-86f2ec4522e9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.256598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.257180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.257458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.257731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/e538cfa7711a4ebf8868138f8520018a/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.275801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=e538cfa7711a4ebf8868138f8520018a, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.277693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.297786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063a62d-bde5-420a-9ec7-04a82c8273e3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.332641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.333266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.333551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.333829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.340580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.342017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:28.352998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:28.353898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 293/596] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:28.354916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.380339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 304/597] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:28 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/e538cfa7711a4ebf8868138f8520018a/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:28.380339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.424211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:28.448705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:28.489119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609e79-7a22-4b27-b100-a2ef7f165f16 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.523522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861b3a-acb5-4d17-8481-d3d6ff982f14 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.537292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.538077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.538449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.538954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.540225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:28.540918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.542666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.562992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.563676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.563952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.564236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.565017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:28.565330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.566787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.567151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 294/598] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Sep 15 10:47:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:28.568095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.583166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 305/599] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:28.584789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.686946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9e25-8e26-4969-ace5-5f7b5d34932c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.722458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:28.723566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:28.732735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.733499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.733673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b52f-11c7-4b82-a154-ffaa5a0431a4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.733966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.734335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.735287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:28.735693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.737858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.756464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 295/600] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:28.757649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.783150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.784255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.784654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.785022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:28.801193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:28.802771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:28.819423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:28.820696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:28.821989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:28.821989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:28.821989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:28.823221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 306/601] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:28.825436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:28.955540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660bd08-b080-4861-91b2-a449469a3e4c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.956403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f26298-5472-4e61-b93c-673b9aac4302 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:28.992095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:28.992737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:28.993017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:28.993291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/3c2b03530d554c27b1dc3282a5063df4/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.002551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f291-2a5d-4f12-b6de-77fa64ca08d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:29.003559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f291-2a5d-4f12-b6de-77fa64ca08d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.004051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f291-2a5d-4f12-b6de-77fa64ca08d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.004561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f291-2a5d-4f12-b6de-77fa64ca08d3 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/1d237fc491984323aa81865c59d71771/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.009036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=3c2b03530d554c27b1dc3282a5063df4, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:29.010524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:29.024354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f291-2a5d-4f12-b6de-77fa64ca08d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=1d237fc491984323aa81865c59d71771, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:29.026490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f291-2a5d-4f12-b6de-77fa64ca08d3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:29.028949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:29.071734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 296/602] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:28 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/3c2b03530d554c27b1dc3282a5063df4/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:29.073043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:29.117771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 307/603] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:28 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/1d237fc491984323aa81865c59d71771/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:29.159152 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:29.202666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a053b7-9cf3-480b-b7a2-b4ed080dfeaf None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.202988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a053b7-9cf3-480b-b7a2-b4ed080dfeaf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.203215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a053b7-9cf3-480b-b7a2-b4ed080dfeaf None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.204945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 308/604] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:29.211796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.212454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.212862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.241252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:29.243470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:29.253115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930dfb-d4bc-4c03-8d6d-ab3cfa2eaf49 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:29.310521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:29.311062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.311344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.311623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.312288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:29.312645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:29.314330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:29.328143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 297/605] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:29.333678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:29.359663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 309/606] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:29.470226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:29.474600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95997f-a450-4aa0-8505-3ce0040a1a56 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:29.516863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:29.517863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.518352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.518819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.526438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:29.528694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:29.548015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:29.548957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:29.549842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:29.552142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 298/607] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:29.557976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:29.639734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:29.689833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455002f-cbb8-460a-8d00-a325570d89db None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:29.719285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:29.734686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:29.735361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.735634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.735904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.738068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:29.738375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:29.739845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:29.767427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 310/608] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:29.774230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:29.827847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e27df-b6ff-4524-b582-dbaab1d28379 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:29.871611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:29.872252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:29.872578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:29.872855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:29.900077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:29.906105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:29.907038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:29.907881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 299/609] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:29.916329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:29.925422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe52b7c-24b3-4ac1-94d3-bffdd84064ba None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:29.956083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:30.001444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:30.002107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:30.002385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:30.002658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/f259e1d9dd2d47e4af4d4dcdc93eaef8/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:30.038805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=f259e1d9dd2d47e4af4d4dcdc93eaef8, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:30.040326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:30.087034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bef866-726a-44fc-b1e2-067d16de0051 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:30.123359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:30.124068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:30.124432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:30.124707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:30.128185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:30.132215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 311/610] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:29 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/f259e1d9dd2d47e4af4d4dcdc93eaef8/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:30.137723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:30.137723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:30.145134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 300/611] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:30.150772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:30.220349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:30.323771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04721b41-4c2a-4e26-8a44-4d98742be5eb None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:30.374989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:30.375632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:30.375907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:30.376177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:30.387668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:30.389200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:30.406354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:30.407343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:30.408845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:30.408845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:30.408845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:30.408845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 312/612] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:30.413065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:30.508698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:30.518307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5813-b044-4395-bd16-2a34f7ca4d7f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:30.553432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:30.554035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:30.554311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:30.554581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:30.555262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:30.555978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:30.561229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:30.578518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 301/613] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:30.583635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:30.691587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:30.707817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016a051-1252-4156-a1a1-8bdd038d2509 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:30.743780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:30.744824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:30.745312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:30.745807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:30.754322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:30.756036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:30.768643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:30.769627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:30.770569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:30.773160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 313/614] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:30.780432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:30.920339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be51ac-8044-471b-81c5-ff7a591f587f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:30.955132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:30.955658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:30.955947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:30.956222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:30.956986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:30.957291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:30.958706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642bd7e-8ef1-45aa-a508-e4fb65f185cc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:30.968122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:30.977136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 302/615] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 15 10:47:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:30.983046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.053249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9743769-41a0-4715-806d-a4563dd48c75 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.053607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9743769-41a0-4715-806d-a4563dd48c75 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.053896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9743769-41a0-4715-806d-a4563dd48c75 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.055366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 303/616] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:31.064089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.064411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.064692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.088449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:31.089632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:31.150532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c3229-976c-4b86-a2e6-c2af17c78665 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:31.200618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:31.201486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.201773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.202052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.214720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:31.216800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:31.220275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 304/617] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:31.223895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:31.232382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:31.233524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:31.234770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:31.234770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:31.234770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:31.236083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 314/618] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:31.242203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.351607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d5fc3-3fd4-481f-b016-93441bd05392 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:31.380719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:31.389799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:31.390426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.390710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.390985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.391661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:31.392053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:31.393505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:31.412278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 305/619] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:31.414304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.538618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708725a-7cff-4e27-8dc3-a5bdab0a1e46 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:31.579020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:31.579667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.579947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.580220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.587401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:31.588859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:31.600990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:31.601963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:31.602858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 315/620] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:31.609191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.635012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.734529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:31.759811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1c560-9302-4900-8f81-b6d674fe61e8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:31.778608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294509bd-9a2b-4fec-ba00-90a568cd5938 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:31.797414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:31.797953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.798236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.798513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.799207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:31.799612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:31.801169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43e3d-ece4-4fef-8029-2497330b6b79 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:31.813933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e14d3-8002-4a11-a507-5b803d16e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:31.814367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 306/621] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:31.814645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e14d3-8002-4a11-a507-5b803d16e366 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.814992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e14d3-8002-4a11-a507-5b803d16e366 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.815207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e14d3-8002-4a11-a507-5b803d16e366 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.815600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fb5bf-a60b-40d8-83c7-ca8f64412d8b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.819891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fb5bf-a60b-40d8-83c7-ca8f64412d8b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.820281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fb5bf-a60b-40d8-83c7-ca8f64412d8b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.821684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 307/622] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:31.822744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fb5bf-a60b-40d8-83c7-ca8f64412d8b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.834533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e14d3-8002-4a11-a507-5b803d16e366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-b26e14d3-8002-4a11-a507-5b803d16e366 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:31.839983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:31.841356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:31.842200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:31.845896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 316/623] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:31.847137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:31.847422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:31.847699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:31.866484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:31.867705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:31.896759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:31.946305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 317/624] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:31.947503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:31.965869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fb5bf-a60b-40d8-83c7-ca8f64412d8b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.001481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:32.016111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bb725-5af0-4c30-abff-358a65b343f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.016902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bb725-5af0-4c30-abff-358a65b343f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.017185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bb725-5af0-4c30-abff-358a65b343f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.017462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bb725-5af0-4c30-abff-358a65b343f6 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/8107c052569f41c3a0d7f188d1642f4d/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.037225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bb725-5af0-4c30-abff-358a65b343f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=8107c052569f41c3a0d7f188d1642f4d, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:32.038687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bb725-5af0-4c30-abff-358a65b343f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:32.066750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2451cd-4fe9-4658-9e05-abc77602d0fd None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.104591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 308/625] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:31 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/8107c052569f41c3a0d7f188d1642f4d/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:32.106136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a68bb8-0a1a-422a-8bdf-40ad191f079b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.106420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a68bb8-0a1a-422a-8bdf-40ad191f079b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.106881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a68bb8-0a1a-422a-8bdf-40ad191f079b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.108529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 309/626] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:32.109786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.110663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.111213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.111719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.113047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:32.113569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:32.114520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.114800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.115069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.116133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:32.127736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 318/627] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:32.138590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.169881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:32.173479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:32.327689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 310/628] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:32.328601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.345660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f01298-aa1e-4212-b5e7-11241bbbe629 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.358207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:32.368730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:32.394174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.395634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.395920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.396202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.425415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:32.426871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:32.457939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:32.459141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:32.460228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:32.460228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:32.460228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:32.460567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 319/629] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:32.469363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.476797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22583-0af7-4be3-bad1-7da99ac43374 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.557590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.558235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.558551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.558837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.585476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:32.591111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:32.592114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:32.592980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:32.600766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 311/630] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:32.609311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.618359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45272-294a-487f-a073-7a0b29239664 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.667220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.667827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.668286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.668597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.669518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:32.669636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:32.671017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:32.684812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 320/631] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:32.685968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.718491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:32.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104efda-261b-40da-94bd-cdd894fda0d7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.736707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:32.772619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.773385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.773759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.774274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.775043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:32.775461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:32.777076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:32.790962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 312/632] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:32.790962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.802095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf028c-c4b4-44cf-8eea-d28de884a736 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.840694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.841324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.841604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.841876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.855421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:32.862506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:32.863548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:32.864678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:32.869656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 321/633] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:32.870673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:32.943642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bff2a8-a8bd-4534-b2a7-365d223a15ab None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.972502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:32.989113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:32.989747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:32.990031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:32.990308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:32.994320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797735d1-eabf-4c37-857d-ae0e44df5de5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:32.998507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:32.999945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:33.011187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:33.012793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:33.013736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 313/634] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:33.015073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.035255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.041689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.042413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.042693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.043018 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.054203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.055640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d8de5b69-181d-4248-94e0-22b5b9627692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:33.070605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:33.071802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:33.072955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:33.072955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:33.072955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:33.076728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 322/635] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:33.077947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d51453-0a26-4043-a15c-5f071346b267 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.078233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d51453-0a26-4043-a15c-5f071346b267 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.078507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d51453-0a26-4043-a15c-5f071346b267 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.079872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 323/636] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:33.084418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d51453-0a26-4043-a15c-5f071346b267 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.129872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f01c-0eaa-437b-ae3f-be41bdec9375 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.164779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.165440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.165721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.165996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.166661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:33.166965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.169264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.177425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 314/637] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:33.178210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.200004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d51453-0a26-4043-a15c-5f071346b267 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.234301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.234942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.235275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.235576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.236271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:33.236605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.238019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741db93-120d-4e17-bfe4-46b883086d39 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.239764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.255569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.261370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 324/638] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:33.261370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.261370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.261370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.276246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:33.277668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:33.286283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2eb2-0cde-4d96-8db3-e57ee154d5fb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.320230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.320857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.321137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.321411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.322056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:33.322360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.323718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.341837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 315/639] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:33.342572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.346889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 325/640] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:33.348226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.456689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8becca-8a45-43a2-9edf-71ad870a5084 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.474872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f295-3b49-485b-8023-4935982431a6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.481891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.493880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.496406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.496406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.496406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.508880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.515491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.517341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.517699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.518051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.533117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.535822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:33.555300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:33.556260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:33.557717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:33.557717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:33.557717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:33.560437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 316/641] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:33.561511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.581585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.583524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.673214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0e3d6-168c-49ca-a3f4-663e01974390 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.691885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 326/642] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:33.691885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.714739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.714970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.715311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.715588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.715865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.724171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.725743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:33.737555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:33.738590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 317/643] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:33.739587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.790158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.803362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1708-ed12-4d29-bf64-27c96ff0dc41 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.839452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.840104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.840439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.840678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.841308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:33.841602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:33.843426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:33.851522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815800f1-bb93-418a-add3-e691634f5219 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:33.859950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 327/644] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:33.859950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.889370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:33.889998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:33.890280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:33.890548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:33.900848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:33.906460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:33.907418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 318/645] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:33.908431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:33.962039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:33.982490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf204b8e-be72-4f04-8bef-80acf5ea539c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.015510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98518c-1475-4bfa-951d-dbdb943b2307 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.017826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.017956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.018458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.018739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.019012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.035782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.037836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.051763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.052415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.052695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.052967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:34.053305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:34.054233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:34.060519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:34.060519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:34.060519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:34.060709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:34.060709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.060838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 328/646] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:34.060905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.060972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.075410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 319/647] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Sep 15 10:47:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:34.076847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.167204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c99d3-c868-430a-a106-d9b9360fde05 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.182684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b1b10-35fc-4934-9419-3d8f40f0c63d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.202547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.203622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.203902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.204175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.206426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.212883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.214309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.217503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.218176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.218458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.218728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.219380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:34.219681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.221047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:34.226217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:34.227340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:34.228610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:34.229270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 329/648] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:34.230074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.242066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 320/649] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:34.242066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.267136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.353516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d896be-6a4a-4c3a-a4cf-94a0b3773e89 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.362025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0dd94-64c3-40a3-a15b-ac8d1364c84e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.391748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.392820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.393281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.393758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.394570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:34.395047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.396649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.396851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.397452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.397727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.397999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.411434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 330/650] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:34.412664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.469602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.471771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.473268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.497337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.512873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d319-6a7f-4583-baa2-8d66c2625268 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.547583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.548243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.548553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.548824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.549565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:34.549870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.551278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.568505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 331/651] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:34.569299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.576069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 321/652] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:34.576069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.669081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa023e-6bf8-47b4-938f-5a256b87cd72 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.676407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f183be-f10d-470c-95c2-3f4f9b2fcf3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.681691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.698910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.703655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.704322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.704633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.704910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.710127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.710736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.711355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.711355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.715594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.717244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.718463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.719885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7ce9f496-51a8-4e42-b3cd-a5b276e01879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:34.730732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:34.731740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:34.732698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:34.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:34.733971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:34.734872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:34.734872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:34.734872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:34.735881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 322/653] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:34.735881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21390b96-335c-4a68-b237-5a3cc0ed3523 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.736193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 332/654] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:34.736193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.736523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21390b96-335c-4a68-b237-5a3cc0ed3523 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.736523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21390b96-335c-4a68-b237-5a3cc0ed3523 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.737432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 323/655] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:34.738141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21390b96-335c-4a68-b237-5a3cc0ed3523 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.837080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0467aa9-5ba0-4098-bf7b-5f3729d61e00 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.837728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21390b96-335c-4a68-b237-5a3cc0ed3523 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:34.870527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.871663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.872016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.872420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.873678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:34.874298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:34.874579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:34.874861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:34.885215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.887228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:34.901040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:34.902020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:34.903390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:34.903390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:34.903390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:34.903390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 324/656] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:34.903390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:34.907763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.937790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:34.941570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:34.943064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.002060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a1577-3517-46ce-a3a7-9465030d3539 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.036800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.037406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.037686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.037958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.038649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:35.038953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.040395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab70970-9047-4419-bc8c-b18fa47f05f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.044536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 333/657] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:35.045378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.053384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 325/658] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:35.054577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.054861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.055132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.072706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:35.073880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:35.106501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.141375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 326/659] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:35.142204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.144896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cfa18-e21e-4d18-ac05-3a0228249e98 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.179812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.180142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.180548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.180832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.181109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.181753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:35.182061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.184016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.196326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 334/660] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:35.197394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.261099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219715-8d97-44dc-a6cc-e29c71cb6892 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.301680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.302285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.302562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.302832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.303155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47a08-272d-48ae-a7dd-67966b05ffd2 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.303465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:35.303762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.306107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.323879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 327/661] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:35.323879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.326668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.336981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.337609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.337894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.338171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.349061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.350555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:35.366078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:35.367663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:35.368825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:35.368825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:35.368825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:35.370218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 335/662] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:35.371165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.422489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.436449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25084-e465-46ea-9b4d-e991fe635983 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.469752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.470356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.470637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.470912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.471137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e971e2-41f0-47ba-8fae-2c30c108098c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.471629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=e538cfa7711a4ebf8868138f8520018a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:35.471935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.473404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.479347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 328/663] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/role_assignments?user.id=e538cfa7711a4ebf8868138f8520018a&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:35.480130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.508586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.509241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.509523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.509799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.519159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.520662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:35.534457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:35.535687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 336/664] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:35.536892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.579932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.607969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862d5f6-2ea6-46ad-8b22-eda2aaf0fb3c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.654923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.655492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.655775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.656054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.663303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.664030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c33f-73e8-42f2-b3bf-1eb5fea18642 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.665012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:35.682433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:35.683986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:35.684970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:35.685975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 329/665] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:35.686789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.705631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.705921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.706499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.707033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.707033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.707672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:35.707975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.709576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.722369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 337/666] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:35.726990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.802871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13bfc8-9447-433a-a67d-a243d77d75c7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.832237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.838334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3fa7-503e-40d9-a261-5bbf6e882b95 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:35.838461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.839042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.839313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.840169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.851395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:35.857018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:35.857938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:35.858774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 330/667] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:35.859494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.878416 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:35.879017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:35.879333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:35.879557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:35.880274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:35.880605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:35.882000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:35.905457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 338/668] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:35.905457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:35.940944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:35.985166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceded8-38ed-4fe4-b1bc-084f0d81f4fa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.021208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c351-b911-4c1b-beef-c8400fd46145 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.023045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.024227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.024227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.024227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.024924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:36.025231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.030129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.043659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 331/669] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:36.044491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.065827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.066448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.066723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.066993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.074728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.076170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:36.088188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:36.089220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 339/670] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:36.090479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.107508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.148059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd9b8-ab61-461c-af4f-9eaa65071863 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.180194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.186925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.187526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.187848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.188149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.188808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:36.193021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.193021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.195449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f677f-9303-4d5d-b3d2-8af3005e4c83 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.198482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 332/671] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:36.200274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.234724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.235453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.235812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.236262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.307869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17610718-b603-4771-9d00-95f05789fc32 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.309246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.310801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.333027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.349512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.358145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.358145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.358145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.358145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=1d237fc491984323aa81865c59d71771) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:36.358145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.358145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.368727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 333/672] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/role_assignments?user.id=1d237fc491984323aa81865c59d71771&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:36.368727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.441250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.446368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 340/673] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:36.450351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.511599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ff19-9405-4307-b974-6e7245b58d06 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.564050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.564710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.564996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.565274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.565453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c213d-4be3-48c7-bc5e-d037527b2d2f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.566097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:36.566411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.567841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.584711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.585982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 334/674] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:36.587135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.612879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.613531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.614015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.614563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.626608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.628051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:36.647442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:36.648501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:36.650675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:36.650675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:36.650675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:36.650675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 341/675] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:36.650675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.713659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83330f-4f25-4489-b4a7-348d2117707a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.733019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.751357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.752004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.752286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.758668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.763709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.765224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:36.780763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:36.781775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:36.782746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:36.782746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:36.782746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:36.782917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eca6f-abf3-4f65-adea-410a5bb40f03 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:36.783016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 335/676] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:36.783016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.830642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:36.831264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:36.831686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:36.831976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:36.832843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=3c2b03530d554c27b1dc3282a5063df4) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:36.833102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:36.835034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:36.842730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 342/677] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/role_assignments?user.id=3c2b03530d554c27b1dc3282a5063df4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:36.843521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:36.909351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:36.963805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61414425-9730-481c-9430-d16d3af95b7a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.043702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46284b9-bead-4163-8b96-6e9f7ff323dc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.054969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.055585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.055868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.056146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.057061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:37.057371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.059418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.075662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 336/678] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:37.082149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:37.089098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.090709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.091216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.091737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.092597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:37.093096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.095236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.111314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 343/679] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:37.117201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:37.122977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:37.211170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d13cf-aa78-4df5-bd2c-eaf2b86c5207 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.233819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:37.247225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773d28-8247-4d12-b75f-50ccb9f95254 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.289525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.289525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.289525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.289525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:37.289930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:37.290715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:37.291901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 337/680] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:37.293378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:37.299039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.299776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.300122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.300496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.310349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.312201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:37.331774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:37.333047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:37.334136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:37.334603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 344/681] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:37.340928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:37.428267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:37.446464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85309cf8-cd18-4059-9dcb-93a781f0efd7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.477133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c41eaa-b68c-4eb0-acc0-6103e42a3fcf None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.503867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.504433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.504718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.504997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.505758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:37.506035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.507459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.523150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.524070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.525391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.525908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.530257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:37.530807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.532471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.546205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 338/682] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 15 10:47:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:37.551791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:37.564003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 345/683] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:37.569703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:37.589287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:37.732831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12ab32-010b-4a11-92a0-e8f1b920c081 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.734851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e21ab5-bf3e-4783-95a6-8cac932f1e89 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:37.781061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.781900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.782184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.782461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.783255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=f259e1d9dd2d47e4af4d4dcdc93eaef8) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:37.783569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.785073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6318-3f5c-4992-b91c-aeb7b123b069 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.796425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 346/684] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:37 2022] GET /identity/v3/role_assignments?user.id=f259e1d9dd2d47e4af4d4dcdc93eaef8&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:37.809891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:37.810528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.810813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.811090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.832760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:37.914172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:37.915641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:37.934948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727396a8-8042-4ee6-8f27-b7f2547ac368 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.935352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727396a8-8042-4ee6-8f27-b7f2547ac368 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.935639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727396a8-8042-4ee6-8f27-b7f2547ac368 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.941435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 347/685] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:37.947024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:37.947321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:37.947579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:37.993470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:37.994779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:38.029032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 339/686] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 10:47:38.036833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.095235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:38.097632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 348/687] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:38.152681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84c695-0896-4189-88a9-6f26370c1218 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:38.188427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:38.189055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.189335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.189607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.199881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:38.201406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:38.216964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:38.217975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:38.218887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:38.218887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:38.218887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:38.218887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 340/688] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:38.224912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.229420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:38.384709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.389753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52126f-5b06-4a13-9048-63ccfa133f9b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:38.436231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:38.436870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.440254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.440254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.440254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:38.440254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:38.440254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:38.460442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 349/689] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:38.466765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.532851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:38.542081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35f34-fb48-4a91-b0b8-fa1b5e68c48f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:38.592676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:38.611706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:38.612375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.612660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.612937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.613531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:38.614885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:38.639625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:38.640756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:38.641617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:38.644769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 341/690] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:38.649086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b949e-f60b-4abe-a116-dc77675583a0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:38.650782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.696760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:38.697387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.697660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.697929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.712483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:38.714071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:38.727731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:38.728751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:38.729885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 350/691] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:38.735669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.871163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d3d57-7343-40f0-991c-676b4d94ecd1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:38.925911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c8a0b-9c1f-4dcb-b3e6-8d6d42b7031a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:38.926752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:38.927515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.927801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.928177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.928866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:38.929170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:38.930619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8e275-2935-452c-81ce-b903e047046d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:38.936504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 342/692] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:38.937854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0464d5-660c-48a2-83fe-9152aa76c2ee None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.938182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0464d5-660c-48a2-83fe-9152aa76c2ee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.938423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0464d5-660c-48a2-83fe-9152aa76c2ee None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.943770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 343/693] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:38.944691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0464d5-660c-48a2-83fe-9152aa76c2ee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:38.956338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:38.968065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:38.969071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.969547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.969973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:38.970736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:38.971114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:38.972719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8b2a2-ca18-41fc-968a-b23e3da79538 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:38.981885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:38.987072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 351/694] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:38.988493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:38.988873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:38.989245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.007961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:39.009302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:39.059470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0464d5-660c-48a2-83fe-9152aa76c2ee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:39.088341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 352/695] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:39.088341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:39.118374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:39.119278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:39.119761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:39.120326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.121921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:39.122370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:39.124027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:39.138060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 344/696] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 15 10:47:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:39.203273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b903-19ca-4830-8d49-7992699d9241 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:39.220064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:39.242155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:39.242767 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:39.243043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:39.243312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.244035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=8107c052569f41c3a0d7f188d1642f4d) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:39.244430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:39.245989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:39.252967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 353/697] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:39 2022] GET /identity/v3/role_assignments?user.id=8107c052569f41c3a0d7f188d1642f4d&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:39.457224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:39.562518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:39.572365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ffef-7417-4d8e-b2a0-1653e151545f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:39.612864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:39.613497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:39.613777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:39.614052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.626106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:39.627565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:39.643218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:39.644237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:39.645203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:39.645203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:39.645203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:39.645203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 345/698] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:39.651037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:39.757047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c77f4-871a-41a2-a7ae-33257cea058f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:39.803207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:39.804250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:39.804810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:39.805287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.806164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:39.806680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:39.808376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02382a-81d8-48b4-8bd7-4c4297924930 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:39.823072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 354/699] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:39.829645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:39.942543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141394c-14bd-438f-9344-7d9aaf7d009a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:39.942830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141394c-14bd-438f-9344-7d9aaf7d009a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:39.943109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141394c-14bd-438f-9344-7d9aaf7d009a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.945069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 355/700] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:39.954019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521f53-39ee-4981-a374-7466936a441c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:39.954534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521f53-39ee-4981-a374-7466936a441c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:39.954969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521f53-39ee-4981-a374-7466936a441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:39.962419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebc6d9-db9f-48de-91a3-15d4c17e244a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:39.996534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b2521f53-39ee-4981-a374-7466936a441c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:39.998031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b2521f53-39ee-4981-a374-7466936a441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:40.014025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa1a2e-56bb-4068-bc26-7d586147a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:40.014567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1a2e-56bb-4068-bc26-7d586147a456 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:40.014900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1a2e-56bb-4068-bc26-7d586147a456 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:40.015183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1a2e-56bb-4068-bc26-7d586147a456 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:40.015840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa1a2e-56bb-4068-bc26-7d586147a456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:40.018931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa1a2e-56bb-4068-bc26-7d586147a456 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:40.056754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:40.099921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 356/701] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:40.127901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:40.138125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 346/702] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:47:39 2022] POST /identity/v3/users => generated 254 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:40.484537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2521f53-39ee-4981-a374-7466936a441c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:40.600428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2521f53-39ee-4981-a374-7466936a441c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:40.606089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd139-70ad-436d-a805-2f913b3d2b59 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:40.606403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd139-70ad-436d-a805-2f913b3d2b59 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:40.606657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd139-70ad-436d-a805-2f913b3d2b59 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:40.608364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 347/703] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:40.615563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:40.616443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:40.617111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:40.642256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:40.642746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:40.644062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:40.644062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:40.644062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:40.645718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:40.659239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:40.666482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:40.667549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:40.669830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 357/704] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:40.674261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:40.724785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:40.756704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 348/705] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:40.819075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef64c-7fad-43c2-a31d-99b70eb913f4 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:40.866022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:40.866648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:40.866923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:40.867195 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:40.867923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:40.868223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:40.869606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:40.884770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 358/706] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:40.889450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.029143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd32a59-18b6-4e01-b482-58d394adeb1c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.068914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:41.087333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.087978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.088259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.088558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.103438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.105003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.107675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:41.124858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:41.125881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:41.128096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:41.128096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:41.128096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:41.128096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 349/707] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:41.131399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.215347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:41.225480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb9d40-28fa-452f-bbb8-ace259c8deef None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.273573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.274215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.274494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.274765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] PATH_INFO: `/v3/services/network` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.275347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.276889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.297260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3cd7a-8897-40de-89a9-a04ec8b0cb7e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:41.303206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:41.305034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:41.306383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 359/708] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:41.316355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.380533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.381261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.381539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.381808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.382464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:41.382767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.384122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.418582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 350/709] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:41.434323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.529112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:41.533688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cd9e3-48b7-462a-8ceb-ec5a017c3250 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.605005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.605911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.606357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.606639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.607330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] RBAC: Adding query filter params (name=network) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:41.607638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.609121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.614143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 360/710] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:41.619170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64435eb-c00c-4528-af48-23b6e77b05d4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.619879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.660468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.661100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.661373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.661642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.668805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:41.677261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.679008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:41.708623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:41.710942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:41.713309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 351/711] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:41.721150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:41.788885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66a741-3006-4812-adff-a4585e7e2419 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.843342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.843955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.844234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.844543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.845173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] RBAC: Adding query filter params (type=network) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:41.845475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.846829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca395a66-2285-4ec4-8883-809090e2d622 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.860730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 361/712] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:41.862158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc704d-f586-4b6a-b6ac-12178a36898c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.862444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc704d-f586-4b6a-b6ac-12178a36898c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.862723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc704d-f586-4b6a-b6ac-12178a36898c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.864284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 362/713] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:41.882379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.882683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.883068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.907546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:41.911307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086e4f-d99a-4876-b0ba-a950a626b937 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:41.932681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:41.934843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:41.952807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:41.954115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:41.954402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:41.954683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:41.955511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:41.955826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:41.957357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:41.981166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 352/714] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:41.989537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:42.093723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 363/715] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 10:47:42.157814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74557b8a-7306-43fa-b5f8-a1861aa413ea None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:42.197366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:42.197974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:42.198252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:42.198525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:42.228685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:42.283922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:42.285529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:42.403077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 353/716] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 10:47:42.417582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:42.438438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:42.466650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:42.528608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:42.546840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f046b-706d-438d-97d7-6baf27b6e271 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:42.580240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17509ba-0c70-4e61-9340-1e53713ce762 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:42.589821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:42.590852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:42.591327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:42.591827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:42.604900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:42.607209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:42.619614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0032f8-a22f-445a-94cd-bc0985c64348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:42.620469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0032f8-a22f-445a-94cd-bc0985c64348 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:42.621540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0032f8-a22f-445a-94cd-bc0985c64348 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:42.621969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0032f8-a22f-445a-94cd-bc0985c64348 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:42.622776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0032f8-a22f-445a-94cd-bc0985c64348 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:42.624301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0032f8-a22f-445a-94cd-bc0985c64348 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fde3038d-f9d9-4d43-84cd-049347824e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:42.625781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:42.626936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:42.627868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:42.627868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:42.627868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:42.628176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 364/717] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:42.629553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc95898-f187-44ff-aba5-dd7cb96f2831 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:42.629995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc95898-f187-44ff-aba5-dd7cb96f2831 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:42.630417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc95898-f187-44ff-aba5-dd7cb96f2831 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:42.632298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 365/718] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:42.633136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc95898-f187-44ff-aba5-dd7cb96f2831 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:42.698856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:42.738558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc95898-f187-44ff-aba5-dd7cb96f2831 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:42.741164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 354/719] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:47:42 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:47:42.742916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:42.743513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:42.743991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:42.766861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:42.768841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:42.825618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:42.826239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:42.826515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:42.826786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:42.827434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:42.827732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:42.830113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:42.858030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 366/720] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:42.863349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:42.926686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 355/721] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:42.986559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d4ff0-30b6-4142-be9b-b53af91280ed None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:43.016759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:43.030956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:43.031608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.033790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.033790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.039299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:43.040772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:43.052762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:43.053762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:43.054719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 367/722] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:43.060727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:43.122400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:43.178094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba2839-d74e-4193-867b-2871da642600 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:43.218300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:43.218910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.219186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.219458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.220153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:43.220486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:43.221907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:43.234420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 356/723] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:43.242049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:43.271861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:43.445736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc374fb-f584-46c5-81e1-949dd45dde8f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:43.468657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec4c3b-8339-4a11-a115-a77259f66696 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:43.480676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:43.503454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:43.503993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.504302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.504900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.505909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=3c2b03530d554c27b1dc3282a5063df4) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:43.506223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:43.507641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8004ce-3e05-46d3-bc6a-be9508c2517f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:43.509878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:43.510782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.511215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.512157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.514461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 368/724] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:43 2022] GET /identity/v3/role_assignments?user.id=3c2b03530d554c27b1dc3282a5063df4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:43.516003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6aca02-3150-4c23-bf7f-1e83e3d35e5f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.516292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6aca02-3150-4c23-bf7f-1e83e3d35e5f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.516594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6aca02-3150-4c23-bf7f-1e83e3d35e5f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.520418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 369/725] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:43.524082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.524414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.524673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.538598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:43.544443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:43.545458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:43.546318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 357/726] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:43.558545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:43.568626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:43.569844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:43.695473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:43.698309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 370/727] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:43.775798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459fe4c7-596e-47c4-a6cb-3ecb360a9adf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:43.815488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:43.816099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:43.816414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:43.816775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:43.817446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:43.817744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:43.819105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:43.828913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 358/728] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:43.834333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:43.998076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979df4bc-604f-4349-9e8d-3c433c966d5f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.060464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.061470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.061973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.062448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.079940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:44.081731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:44.098435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:44.104548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:44.105620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:44.106516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:44.106516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:44.106516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:44.108563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 371/729] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:44.113823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.145106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:44.170236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:44.256798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20b25-65d0-4dbe-8782-69755ed62c49 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.291214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8d06b-d6e8-4f5e-9646-f64f6035a265 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.291739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.292246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.293092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.293366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.294004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:44.294302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:44.295654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:44.307686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 372/730] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:44.313785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.354282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fbf34-2f1b-4777-b53e-108411e23cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.354918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbf34-2f1b-4777-b53e-108411e23cbd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.355379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbf34-2f1b-4777-b53e-108411e23cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.355461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fbf34-2f1b-4777-b53e-108411e23cbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.374849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fbf34-2f1b-4777-b53e-108411e23cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b04fbf34-2f1b-4777-b53e-108411e23cbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:44.381498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:44.382456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:44.383309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 359/731] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:44.384524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960243b-56c3-459b-9360-0f84b27577ed None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.384524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960243b-56c3-459b-9360-0f84b27577ed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.384815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960243b-56c3-459b-9360-0f84b27577ed None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.390865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 360/732] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:44.392085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026061d2-85dc-43f3-8961-99aca56823df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.392460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026061d2-85dc-43f3-8961-99aca56823df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.392735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026061d2-85dc-43f3-8961-99aca56823df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.413420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-026061d2-85dc-43f3-8961-99aca56823df None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:44.414678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-026061d2-85dc-43f3-8961-99aca56823df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:44.447828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:44.467954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb5d1d-ae94-4470-b117-aab31de2d516 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.512411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 361/733] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 10:47:44.513385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026061d2-85dc-43f3-8961-99aca56823df None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.518020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.518659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.518939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.519215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.538436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:44.542191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:44.547158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:44.562851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:44.563836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:44.564832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:44.571880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 373/734] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:44.581678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.697739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026061d2-85dc-43f3-8961-99aca56823df None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.759668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.760269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.760569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.760835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.761626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:44.761924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:44.763281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:44.771029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8791b7-e4e8-4da4-8cc9-5d7f64b137f8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.785080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 362/735] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:44.787973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.842986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.843624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.844275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.844573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.845755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:44.846061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:44.847913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:44.873473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 374/736] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:44.873473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:44.876279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:44.894460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:44.913064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699d51d-24e6-440c-8681-09b28466a53e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:44.948686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:44.949406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:44.949691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:44.949970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:44.960975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:44.962420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:44.977732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:44.978791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:44.980706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:44.980706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:44.980706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:44.980706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 363/737] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:44.980706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.005615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88e3dc-ad93-41aa-9f59-c06c4134ae80 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.048742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.049462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.049795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.050078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.050738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.052844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.119817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 375/738] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:47:44 2022] POST /identity/v3/services => generated 240 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:45.121436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.122472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca75ea-ea3c-4a59-a5ad-7bd394c2ce5a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.205980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:45.216857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.220035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.220588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.221092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.268602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:45.326019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24598-69dd-4c91-bd79-bce4d0d817fe None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.340579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.342806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.362555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.363544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.363544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.363857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.364470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:45.364771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.366419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.382899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 376/739] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:45.388673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.469270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 364/740] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:47:45.475359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.510677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:45.511893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7e37-e9ea-4f77-bb1c-d684765ded9b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.544151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:45.559448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.560071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.560395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.561174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.571363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.572835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-51a5c486-b17e-4bbc-9365-32d26071c199 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:45.599798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:45.600914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:47:45.601894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:45.602430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f428-6711-4cee-a58a-17f983aa26ce None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.602526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 377/741] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:45.602526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a8c6-afcd-4142-954d-79591a5c20c9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.602526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a8c6-afcd-4142-954d-79591a5c20c9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.602526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a8c6-afcd-4142-954d-79591a5c20c9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.603370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 378/742] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:45.609209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7a8c6-afcd-4142-954d-79591a5c20c9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.647172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.647793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.648072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.648365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.661179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.662777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2f2e4e13-5adf-4dfe-966c-e9e86dd7ef24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:45.678544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:45.679557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:45.680499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:45.680499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:45.680499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:45.680499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 365/743] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:45.686389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.686736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.687087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.705813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:45.707136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:45.720234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7a8c6-afcd-4142-954d-79591a5c20c9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.758844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.759700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.760121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.760591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.762100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:45.762636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.764211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.788338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 366/744] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:45.788338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.794411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 379/745] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:45.796724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:45.800226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:45.849381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:45.915573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0a5f-4764-4356-bd3a-e9ca38bdb38e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.956407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:45.957109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:45.957456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:45.957797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:45.958507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:45.958874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:45.959330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b272ebb-3fbc-4dae-b786-7bc714fa77ca None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:45.964340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:45.977682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 367/746] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:45.980492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.056333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301bed7-ae06-439d-b8ca-034c7b062aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.056333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301bed7-ae06-439d-b8ca-034c7b062aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.056333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301bed7-ae06-439d-b8ca-034c7b062aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.056333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301bed7-ae06-439d-b8ca-034c7b062aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.057958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.091881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099a09-c07d-4847-a59d-20bd58eef204 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.125662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301bed7-ae06-439d-b8ca-034c7b062aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.127475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301bed7-ae06-439d-b8ca-034c7b062aa2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.130078 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.130914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.131286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.131651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.139103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.142155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-651374f0-0ddf-42a5-adbe-a6e9e0096e79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:46.153405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:46.154564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:46.155657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:46.161947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 368/747] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:46.163571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce3a9-2432-4b26-a50c-2359d8dbe5b1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.163990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce3a9-2432-4b26-a50c-2359d8dbe5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.164417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ce3a9-2432-4b26-a50c-2359d8dbe5b1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.166103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 369/748] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:46.167001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ce3a9-2432-4b26-a50c-2359d8dbe5b1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.185041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.248205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 380/749] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 10:47:46.249913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.250206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.250483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.272634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:46.273823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:46.279599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ce3a9-2432-4b26-a50c-2359d8dbe5b1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.311463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.316286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.316936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.317222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.317503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.318220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:46.318530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.320098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.332786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 370/750] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:46.333613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.353438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 381/751] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:46.354521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.447015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.462634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d039af-a77e-4275-9a0a-9e22a1140515 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.478310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d5c35-7e60-4e75-8c19-d75f633172da None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.513540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.514442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.514957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.515408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.515965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.516462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.516863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.517214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.517563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.518609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:46.529080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:46.530108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:46.530948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:46.535270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.535393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 371/752] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:46.536203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.537313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:46.558250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:46.559379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:46.560276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:46.560276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:46.560276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:46.561755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 382/753] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:46.563500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.599229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.647325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847502-7320-40ee-9339-e6457e2bc790 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.686008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.686618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.686904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.687016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb2b95-c04e-4f4f-b071-f49d6cc73683 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.687179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.687914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=8107c052569f41c3a0d7f188d1642f4d) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:46.688225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.689697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.695151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 372/754] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/role_assignments?user.id=8107c052569f41c3a0d7f188d1642f4d&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:46.695940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.726314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.741705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.742655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.743648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.746434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.746434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:46.746434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.748389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.759514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 383/755] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:46.759514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.824590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235eb0-380e-49ef-8bcf-bc84763897eb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.848966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:46.865690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.866197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.866436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.866687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.867346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:46.867653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:46.869101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:46.884281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 373/756] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:46.885090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:46.908777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bac96-e622-4698-bae6-8893ab103a52 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:46.946716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:46.947347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:46.947626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:46.947920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:46.960591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:46.969063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:46.970059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:46.970897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 384/757] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:46.971674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.005063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae998f3-fca1-47aa-8b69-c6a66664be74 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.043641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.048745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.049470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.049817 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.050164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.050942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:47.051387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.052724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.063525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 374/758] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.063525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.112754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.117198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3ebc7-b877-4def-a61e-96d0b5449c5c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.166628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.168454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.169353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.170235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.175986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c577a-6482-4684-a967-ac478bc903ab None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.180283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.181994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:47.199343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:47.200327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:47.201243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:47.202264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 385/759] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:47.202780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.225426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.226158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.226509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.226907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.228173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:47.228795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.230538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.243852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 375/760] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.244758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.326118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174a2f5-0035-49ba-90ce-836d75ea0feb None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.338165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.359492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b2f3-4082-42ca-b33a-87f89fa0f93e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.367819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.373505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.374304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.374918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.375696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.376912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] RBAC: Adding query filter params (interface=public, service_id=b6b875f61c604278b3d42137a6cdae01, region_id=RegionOne) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:47.382034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.382034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.389854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 386/761] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/endpoints?service_id=b6b875f61c604278b3d42137a6cdae01&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.394563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.410922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.411896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.412638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.413623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.414807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:47.415320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.418332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.436718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 376/762] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.437952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.508185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9615d81-91c5-462c-8127-5c6ee9a857e9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.557168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.558415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.559109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.559713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.573011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48fbd4-2227-481f-b7ec-650abcd9e9c2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.577686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.579482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:47.600574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:47.601608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:47.602505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:47.602505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:47.602505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:47.605408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 387/763] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:47.606433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.617178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.617795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.618075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.618348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.618963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.620352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.626283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 377/764] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.626918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.644724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.668610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.751875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058a7f-6495-484b-b9d6-0c5b23afb941 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.759857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613366c7-c5ef-4b9c-af69-9d2a266f43c7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:47.800814 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.801596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.801970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.802354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.803154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:47.803286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=b4ecd6883cc643a59598254944fe52f4) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:47.803732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.804359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.804783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.805197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.805407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92923b99-adc4-4ae9-8e19-d0d6134598a8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.806143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:47.813855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:47.813855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:47.814128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 388/765] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/role_assignments?user.id=b4ecd6883cc643a59598254944fe52f4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.815467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415e5a4-3fbc-448a-8e02-4478f62207a9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.815819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415e5a4-3fbc-448a-8e02-4478f62207a9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.816281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415e5a4-3fbc-448a-8e02-4478f62207a9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.824672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 389/766] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:47.825943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:47.826234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:47.826512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:47.837182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 378/767] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:47.838350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:47.850204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:47.851478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:47.943909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 390/768] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:47.967144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:47.977955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4784a2-e9de-439b-a550-668edcd74c32 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:48.026417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:48.027133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:48.027444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:48.027783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:48.036513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:48.037985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:48.056612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:48.057630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:48.059473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:48.062263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 379/769] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:47:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:48.069421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.096772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:48.194753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2a68-3d0b-4a2c-b422-4eb75c45f3c9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:48.231158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:48.231776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:48.232054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:48.232344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:48.233169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:48.233473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:48.234904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:48.258236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 391/770] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:48.264411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.265884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.403836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:48.429184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304806e8-9535-4acc-91be-231cf1eb3c88 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:48.456128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b204-5e0a-4a9f-84dd-da5db2e30a77 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:48.485329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:48.485969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:48.486246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:48.486517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:48.487105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:48.488502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:48.509028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:48.510082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:48.510920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 380/771] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:48.517010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.533702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:48.534347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:48.534623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:48.534900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:48.557135 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:48.559434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:48.572683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:48.595098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:48.597386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:48.599539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:48.599539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:48.599539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:48.599539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 392/772] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:48.611511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.752424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d1d8-0c57-4378-9bfb-3611bedf6bc5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:48.781204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bdff9-089b-4706-8f9b-64547974d7f3 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:48.813980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:48.814600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:48.814877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:48.815157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:48.816440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] RBAC: Adding query filter params (name=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:48.816440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:48.817832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:48.828349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 381/773] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:48.829368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:48.835037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.851660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:48.852280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:48.852591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:48.852858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:48.853511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:48.853806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:48.855692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:48.881414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 393/774] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:48.887901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:48.980763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:49.019527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff2b86-e987-4a71-83bc-bff3ba4b031a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.076762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472b57-1380-4e42-be1f-24448bf191e8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.088515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.089702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.089999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.090252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.091036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:49.091338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:49.092888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:49.108717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 382/775] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:49.124757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:49.152238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.153208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.153488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.153862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.162666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:49.164274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8ad496f3-3a7b-45a6-a6e8-b522af223fa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:49.177315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:49.178239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:49.179120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 394/776] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:49.180111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773e75-09bc-4803-95d8-40a3ee31230e None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.180218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773e75-09bc-4803-95d8-40a3ee31230e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.180522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773e75-09bc-4803-95d8-40a3ee31230e None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.182236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 395/777] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:49.188034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87773e75-09bc-4803-95d8-40a3ee31230e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:49.245348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:49.266557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944fa41-2629-4e3c-b61e-968b57a6b1f6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.303904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87773e75-09bc-4803-95d8-40a3ee31230e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.309875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.310494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.310777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.311052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.311822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] RBAC: Adding query filter params (interface=public, service_id=874cccdaa9d24be49841786f41469efb, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:49.312136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:49.313527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779df4b-f38b-464c-9618-83b8d3e151da None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:49.326305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 383/778] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:47:49 2022] GET /identity/v3/endpoints?service_id=874cccdaa9d24be49841786f41469efb&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:49.326305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.326305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.326305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.337033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:49.343293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:49.344537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:49.350997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.351907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.352777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.353212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.354175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:49.355095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:49.357422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:49.376600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 396/779] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:49.377776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:49.422222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 384/780] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:49.429149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:49.496406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875baf91-2e52-4dad-9c58-3c5e25a2722a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.516295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:49.553881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.556662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.557102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.557774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.559186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:49.561869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:49.575999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 397/781] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:47:49 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:49.611607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff2c9d-496c-4a76-b170-a2b3143bdc9c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.651266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.652384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.652806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.653222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/3c2b03530d554c27b1dc3282a5063df4/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.655351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=3c2b03530d554c27b1dc3282a5063df4, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:49.656949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:49.660507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:49.741201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 385/782] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:49 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/3c2b03530d554c27b1dc3282a5063df4/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:49.748459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:49.891065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565c0f3-e628-48b5-a4b4-a974ea4a4753 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:49.937303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:49.938407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:49.938882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:49.939344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:49.961269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:49.967262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:49.968207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:49.969180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:49.971486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 398/783] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:49.977266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:50.112219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a766-95c4-4335-b84f-4d1f4f6cbeed None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:50.150414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:50.150959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.151242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.151519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.152289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:50.152665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:50.154042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfc95d-ecbc-44c1-ab6a-0be2c7a7079e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:50.167057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 386/784] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:50.172912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:50.194189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abeff9-63e0-4ebe-a5d3-95619491d9ed None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.194519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abeff9-63e0-4ebe-a5d3-95619491d9ed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.194745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abeff9-63e0-4ebe-a5d3-95619491d9ed None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.196089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 387/785] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:50.201737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.202025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.202365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.226861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:50.228273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:50.232669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:50.336677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:50.345615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896cfc-6bb6-4a4d-b858-4400acb8dafc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:50.369528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 388/786] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:50.407016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:50.407576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.407854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.408132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.422295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:50.423745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c1ecc287-636a-4759-a5df-96919913205a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:50.452406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:50.453427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:50.454322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:50.454322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:50.454322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:50.456395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 399/787] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:50.461768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:50.568300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b60f1-b3a7-47a5-97b3-2f7ec34d3d60 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.569078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b60f1-b3a7-47a5-97b3-2f7ec34d3d60 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.569683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b60f1-b3a7-47a5-97b3-2f7ec34d3d60 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.571443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 400/788] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:50.585485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.586221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.587064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.616413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a2c3-4d04-4925-869e-ec20648769bf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:50.623285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:50.624517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:50.680892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:50.681431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.681715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.681993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.682646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:50.683554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:50.686451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:50.701846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 389/789] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:50.702702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:50.742070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 401/790] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:47:50.743035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:50.779904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:50.793570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:50.900983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c9e2-7e1f-4a77-a8ec-f8fbd83c4ab6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:50.957407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e3bb1-7f15-4b4f-85ba-fac3da87daec None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:50.958473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:50.959110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:50.959390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:50.959666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:50.960412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:50.961918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:50.973274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:50.974337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:50.975254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 390/791] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Sep 15 10:47:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:50.981032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.040036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.040714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.042648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.042936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.058905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.063645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.153744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26d13-189f-4016-ae17-076cd88a38fe None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.170818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:51.195571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.196197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.196509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.196790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.197440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:51.197748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.199689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.205251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 391/792] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 15 10:47:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:51.206080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:51.218557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:51.219852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 402/793] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:51.220822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.318354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:51.332961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13ac74-0179-45e9-92dc-6ddf61dc5ca4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.347950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf06086-b3df-4604-b6e5-f094a52df180 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.381447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.382085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.382370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.382816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.387240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.388099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.388630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.389094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.389906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:51.390449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.392144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.394081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:51.398625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 403/794] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:51.400334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:51.402575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:51.404065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:51.405392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.407074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 392/795] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:51.407944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.457026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:51.518210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f49a9-ae19-4c1b-a4bd-fdb1ddceecd5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.544550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc8c81-4924-4a89-8db2-5edd6f9e0828 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.557655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.559185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.559717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.560376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.561473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:51.562000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.563805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.572757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:51.583875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 404/796] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:51.592395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.595119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.595744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.596029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.596337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.597006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.598390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.694704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe11f62-01ea-46d3-9411-1e78d55b246a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.719217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 393/797] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:47:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:51.720537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.773271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.775448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.777339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.777891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.779736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:51.780258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.782202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.803041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 405/798] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:51.809715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:51.882225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:51.893770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4cf2-1ab8-493b-ad30-98d92b6b471b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:51.931821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:51.935828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:51.936596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:51.937063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:51.937242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:51.952712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:51.954367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:51.973493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:51.974489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:51.975370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:51.975370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:51.975370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:51.975370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 394/799] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:51.982057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.030861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53e032-8ef2-4f5d-8749-358a0c6cdb98 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.084923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.085925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.086449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.086929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.100190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.102030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.113162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b8f24-5ad5-4ad7-a0d4-647eff029b59 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:52.117483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:52.118480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:52.119390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:52.119390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:52.119390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:52.122086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 406/800] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:52.128778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.159118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.160094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.160639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.161119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.161956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:52.162534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.164428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9159289-6aed-4e75-9f1a-c359c02c3112 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.178094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 395/801] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:52.179579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0561502-83b8-4154-80a4-8eaeadea13f6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.179862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0561502-83b8-4154-80a4-8eaeadea13f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.180133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0561502-83b8-4154-80a4-8eaeadea13f6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.181635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 396/802] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:52.187815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0561502-83b8-4154-80a4-8eaeadea13f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.191478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:52.280529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701c56-3b18-492a-9901-4f4b06c7ab97 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.289497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:52.302481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0561502-83b8-4154-80a4-8eaeadea13f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.324268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.325695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.325970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.326518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.327223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:52.327526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.329816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b890c3-dbb6-4ecc-93c1-6261a93c295e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.341100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.341933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.342285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.342639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.345828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 407/803] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:52.347124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd230c3e-9136-447e-a9e4-f7fe8999413f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.347410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd230c3e-9136-447e-a9e4-f7fe8999413f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.347681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd230c3e-9136-447e-a9e4-f7fe8999413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.354488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.356538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.366484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-fd230c3e-9136-447e-a9e4-f7fe8999413f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:52.367651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fd230c3e-9136-447e-a9e4-f7fe8999413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:52.368754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:52.369626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:52.371067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 397/804] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:52.372665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.446403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:52.453538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 408/805] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:52.454645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d058-39e8-4b53-b251-14c019c6e83e None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.454944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d058-39e8-4b53-b251-14c019c6e83e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.455302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d058-39e8-4b53-b251-14c019c6e83e None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.464734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 409/806] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:52.464734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d058-39e8-4b53-b251-14c019c6e83e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.498309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb471-cbf4-4b38-b104-1f9725caaa1a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.534461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b29797-5794-4a86-824b-948865482794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.535091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29797-5794-4a86-824b-948865482794 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.535373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29797-5794-4a86-824b-948865482794 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.535652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29797-5794-4a86-824b-948865482794 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.584837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:52.592241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d058-39e8-4b53-b251-14c019c6e83e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.632265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.633321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.633794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.634267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.635158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:52.635664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.638182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61153505-c550-477d-8ed2-3de9b730b2aa None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.656209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 410/807] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:52.657938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.658421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.658911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.661021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b29797-5794-4a86-824b-948865482794 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.662467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b29797-5794-4a86-824b-948865482794 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a6b29797-5794-4a86-824b-948865482794 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:52.676776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:52.677761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:52.678700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 398/808] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:52.679280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b29797-5794-4a86-824b-948865482794 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.684121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:52.685524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:52.776132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 411/809] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:52.778112 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.808183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b29797-5794-4a86-824b-948865482794 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.834510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:52.846873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.848028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.848946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.849386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/8107c052569f41c3a0d7f188d1642f4d/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.852944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=8107c052569f41c3a0d7f188d1642f4d, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.854590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.867543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:52.882819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399918b-89e7-4f4a-aacb-a0be64f32a1c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:52.916379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:52.916981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:52.917908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:52.918184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:52.918892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:52.919195 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:52.920646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:52.932863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 399/810] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:52 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/8107c052569f41c3a0d7f188d1642f4d/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:52.934682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:52.942603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 412/811] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:52.943710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.063229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e09e52-1c20-4cfe-ab2b-19dbc5118ddc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.092231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113a5e5-fb67-40f3-8200-a8818bf7ab44 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.109776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.110847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.111216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.111601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.127737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.130103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.132582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.133509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.133626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.134027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.134436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.146093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:53.149930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:53.150911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:53.153035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:53.153035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:53.153035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:53.154967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:53.155903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:53.157109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:53.157759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 413/812] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:53.158167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.159723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 400/813] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:53.182442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.237003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.291514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5939a1a-e0cd-4866-9dce-850f8e550609 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.324402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea123aa-b73e-4c0f-a196-813594cb8f89 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.329399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.330008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.330285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.330561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.331200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:53.331503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.332921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.347495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 414/814] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:53.348367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.361841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.362400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.362680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.362955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.363542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.364939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:53.374660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:53.375673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:53.376561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 401/815] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:53.378255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.422899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.481342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1ad8a-87d4-41e8-8a42-3f5a81f5a96a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.485398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26620-6340-4aab-ab01-dc9f101f2aa7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.495915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.522976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.523627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.523763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.523907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.524187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.524827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.525253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.525704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.526736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:53.527480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.529324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.532631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.534073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.538900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 415/816] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:53.539942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:53.547458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:53.548588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 402/817] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:53.549704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.660150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dfa29-ce06-43e4-8bfc-0b4e3253e048 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.665281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1dba-e3c0-4499-9a1c-3381bd06bfd3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.684104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.702095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.702875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.703234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.703606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.704378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] RBAC: Adding query filter params (name=network) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:53.704688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.704790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.705448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.705799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.706036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.706137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.711159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 416/818] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:53.712030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.718111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.719700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:53.737023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:53.737983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:53.738962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:53.738962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:53.738962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:53.743452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 403/819] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:53.744489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.769345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.817186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc5965-fe4d-49c2-a71a-ca7cbfc58283 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.854547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.855432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.855963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.856425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.857248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:53.857692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.858862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88627a0-8895-4fdb-bfff-93f4de58d840 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:53.859406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.874383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 417/820] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:53.875559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.903487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:53.904170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:53.904486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:53.904766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:53.905403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] RBAC: Adding query filter params (type=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:53.905709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:53.907268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:53.913109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 404/821] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:53.913944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:53.924324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:53.983343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2032-116d-48ac-a055-86ce9cde3550 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.003954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:54.021410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.022340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.022657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd6de9-05f6-4235-87a0-3ce2b31787ca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.023008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.023456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.024286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:54.024799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.026383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.045173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 418/822] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:54.046835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:54.069394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.070056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.070562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.070669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/b4ecd6883cc643a59598254944fe52f4/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.086484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=b4ecd6883cc643a59598254944fe52f4, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.087927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.157957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557b0ab-1d01-4742-9b23-36645130eac6 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.159559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:54.184798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 405/823] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:47:53 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/b4ecd6883cc643a59598254944fe52f4/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:47:54.184798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:54.222679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43804a-80fb-45b7-b199-8c2fbdf628fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.223311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43804a-80fb-45b7-b199-8c2fbdf628fc None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.223586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43804a-80fb-45b7-b199-8c2fbdf628fc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.223858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43804a-80fb-45b7-b199-8c2fbdf628fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.224569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43804a-80fb-45b7-b199-8c2fbdf628fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.225968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43804a-80fb-45b7-b199-8c2fbdf628fc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.325981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 419/824] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:47:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:54.327201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c477f7-661b-4775-b990-4d7b782683c9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.327495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c477f7-661b-4775-b990-4d7b782683c9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.327773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c477f7-661b-4775-b990-4d7b782683c9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.329441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 420/825] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:54.335916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.336196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.336659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.343814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008c1b0-f876-42f5-a0de-faf8a793630e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.357607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:54.359006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:54.388606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:54.403040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.405192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.406713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.407186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.421269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.424286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:54.443882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:54.445105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:47:54.446257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:54.447334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 406/826] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:47:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:54.455338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:54.466811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 421/827] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:47:54.578402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8513d4-3e14-41c8-ae0e-9e7838ae3acf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.613403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.614013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.614289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.614560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.615275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:54.615573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.617336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.640011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 407/828] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:47:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:54.645907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:54.741566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:54.756931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52756257-a1b1-4552-be49-feb846767ac8 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.791458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:54.806621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.807620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.808083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.808595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.857101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:54.910175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.912477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.913448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831361-3a9f-49bb-8e0c-b7b8c4158d70 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:54.959384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:54.960362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:54.960837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:54.961283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:54.962030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:54.963554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:54.973656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:54.974678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:47:54.975526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:54.978380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 408/829] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:54.984442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.013099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:55.032660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 422/830] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:47:55.035164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.116802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57083870-5f99-4d3a-86e9-03da8485dbc4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.133355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:55.159475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.160514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.160968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.161218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52039639-429f-41e8-9efc-821e6e3499bc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.161605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.162407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:55.162893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.164448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:55.169663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 409/831] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:55.175045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.207050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.207680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.207954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.208222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.225332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.227072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:55.243513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:55.244575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:55.245552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:55.245552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:55.245552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:55.247741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 423/832] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:55.253809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.308353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:55.312779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa431-1f8d-45a0-955c-58588087fe4a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.363663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.364477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.364856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.365487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.367025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:55.367433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.369203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1689-355c-49ee-aa0e-53b55e941d11 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:55.381505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 410/833] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:55.399096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed5ba-30df-40c9-8f7f-ba4359565223 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.435958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ae7b-c7cb-4c00-9bad-48b6f4fa58ff None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.436246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ae7b-c7cb-4c00-9bad-48b6f4fa58ff None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.436563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ae7b-c7cb-4c00-9bad-48b6f4fa58ff None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.438200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 411/834] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:47:55.438747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.439468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.439846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.440239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.441031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:55.441431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.442911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:55.443871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.444161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.444484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.457998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 424/835] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:55.463781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.465203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:55.466593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:55.505280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:55.549826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 412/836] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:47:55.572517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:55.577126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca690-2c97-42bb-a1b9-41424270a83e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.617816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.618684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.619107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.619809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.626956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.628662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:55.640801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:55.641876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:55.642880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:55.648447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 425/837] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:55.653395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.756582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef60d7b-0247-48b4-8093-5088a8d90a0b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.792911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.794126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.794581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.795023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.795902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:55.796393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.797972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:55.815157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 413/838] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:55.816743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.833403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:55.873728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:55.949979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ce87-cbd6-40df-90b9-0e2383504d74 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.969361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc483b76-9787-49c3-8d52-7397214d2f93 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:55.992825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:55.993426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:55.993700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:55.994124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:55.994847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=3c2b03530d554c27b1dc3282a5063df4) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:55.995153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:55.997028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:56.012757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 426/839] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/role_assignments?user.id=3c2b03530d554c27b1dc3282a5063df4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:56.023083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:56.024134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.024664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.025165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.039750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:56.045751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:56.046808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:47:56.047689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:56.050582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 414/840] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:56.057501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:56.089845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:56.178418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb7255-0e81-47b7-bb05-590bdb0d864a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:56.215395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:56.216546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.217144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.217621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.218482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:56.218925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:56.220446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:56.230349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 427/841] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:47:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:56.236539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:56.341803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:56.351440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ab8d-bc66-4f0e-a3fe-51e38245c52a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:56.387157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:56.387998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.388499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.389245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.399881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:56.401332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:56.417615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:56.418600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:56.419535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:56.419535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:56.419535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:56.419535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 415/842] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:56.429396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:56.528212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:56.543577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e8271-84c3-4191-bb93-83a21296bf30 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:56.581491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:56.582123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.582403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.582724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.583390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:56.583693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:56.585134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3999f5d-0f78-44ba-80b4-7eee8f1a03da None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:56.599522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 428/843] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:56.605317 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:56.683584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12484-d74b-431e-ac70-53f0eae27729 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.684203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12484-d74b-431e-ac70-53f0eae27729 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.684731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12484-d74b-431e-ac70-53f0eae27729 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.686524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 429/844] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:56.692366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.692963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.693439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.715048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbbb12-13a8-4f22-aaf3-16da4edb8939 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:56.715927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:56.718330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:56.754790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:56.755420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.755705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.755994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.765019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:56.766451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:56.779367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:56.780382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:56.781351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 416/845] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:47:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:56.788023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:56.791843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:56.811924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 430/846] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:56.899286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0f73a-17af-41f5-ba2f-d90cc3e8e0cd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:56.934797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:56.935692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:56.936146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:56.936598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:56.937635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:56.938161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:56.939871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:56.958424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 417/847] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Sep 15 10:47:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:56.965261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.056683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.069089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1e641-c3ad-4525-a1eb-f202c7801fae None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.103121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.106901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.107758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.108240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.108740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.179985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.181758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.184786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.240390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96649eb-83f0-4627-85b2-9d0432824736 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.267852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.290379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.291438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.291893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.292271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.295111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 431/848] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:47:57.300530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.310058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:47:57.316432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:57.317347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:47:57.318189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:57.318821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 418/849] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:57.325294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.426161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66a3e-c264-4a41-9f9d-067da809f2e5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.445548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0937782-df1a-4fac-8dad-a05dc767de3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.466324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.467007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.467378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.467649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.471796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.480457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.482096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.488833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.489445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.489727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.490007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.491368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:57.491685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.493476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:57.499461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:57.500599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:57.501712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:57.501712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:57.501712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:57.502450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 419/850] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:57.503413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 432/851] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:57.509345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.510486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.544342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.626843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1844-e0e8-42d6-81b5-d01427d8def9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.632607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1f3-b59b-4409-9c12-04987c158501 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.664872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.665481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.665762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.666038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.666676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:57.667001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.668546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c8fb0-dfef-42b4-a557-52bb3ed8d642 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.669395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.670020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.670302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.670576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.684395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 433/852] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:57.684563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.684644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb08fa-f368-4949-b90f-fd874b2a6c41 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.684644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb08fa-f368-4949-b90f-fd874b2a6c41 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.684794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.684890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb08fa-f368-4949-b90f-fd874b2a6c41 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.684890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 434/853] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:57.690492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.690780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.691056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:57.701886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:57.702818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:57.703721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:57.703721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:57.703721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:57.707672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 420/854] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:57.708361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.714674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:57.716194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:57.746566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.792425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 435/855] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:57.792425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.812333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:57.827624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba23ae-965b-4d4d-abab-ae59bfe3418d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.862384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.863021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.863304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.863582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.870788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.872235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:57.883695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:57.884655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:57.885599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 421/856] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:57.891039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.923886 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd412193-ddf3-4935-b0ff-a27526121713 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:57.965983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:57.966914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:57.967414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:57.967877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:57.968735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:57.969245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:57.970802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:57.984544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 436/857] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:57.991031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:57.993620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.003122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ac2fa-443a-4f14-8e10-84ca6dd59a89 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.049424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.050096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.050381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.050661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.051359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:58.051665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:58.053137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:58.070910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 422/858] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:58.072050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:58.095043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.116165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72839a1-3361-4546-9fb3-c535de63e507 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.154415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.155046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.155322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.155594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.164794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:58.166208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:47:58.178119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:58.179288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:47:58.180521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:58.181664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86817e00-7630-4744-a6ef-d1c4d5a19f2f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.184344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 437/859] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:47:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:58.185236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:58.222542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.223994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.224272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.224579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.225342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=8107c052569f41c3a0d7f188d1642f4d) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:58.225652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:58.227129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:58.244357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 423/860] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:58 2022] GET /identity/v3/role_assignments?user.id=8107c052569f41c3a0d7f188d1642f4d&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:58.244357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:58.267012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.316625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821e2c2-1302-4901-8869-94ea8568b771 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.358623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93ec8b-12e2-4792-8614-4ef53383690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.359252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93ec8b-12e2-4792-8614-4ef53383690f None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.359527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93ec8b-12e2-4792-8614-4ef53383690f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.359795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93ec8b-12e2-4792-8614-4ef53383690f None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.360489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93ec8b-12e2-4792-8614-4ef53383690f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:58.361853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93ec8b-12e2-4792-8614-4ef53383690f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:58.368438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cba867-5d49-44f8-b0fd-0eac0303d5f6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.404603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.405233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.405513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.405784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.406527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:58.406836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:58.408282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e9a7-0df2-4f44-8b8d-426420c9857a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:58.428006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 424/861] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 15 10:47:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:58.429419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b60b-53d8-4b1e-8898-6c83f5b4dcc0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.429709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b60b-53d8-4b1e-8898-6c83f5b4dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.429980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3b60b-53d8-4b1e-8898-6c83f5b4dcc0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.431163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 425/862] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:47:58.435722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.436278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b60b-53d8-4b1e-8898-6c83f5b4dcc0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:58.448434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 438/863] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:47:58 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:47:58.448434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.448434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.448434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.469036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:47:58.471237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:47:58.550157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.586628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3b60b-53d8-4b1e-8898-6c83f5b4dcc0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.590590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 439/864] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:47:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:47:58.627891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.628542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.628829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.629102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.702159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:58.703638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:58.789338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.821777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 426/865] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:47:58 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:47:58.827894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:58.861937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:58.946134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5387230-6971-462a-961d-d76be0ea3845 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:58.973792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:58.987167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:58.987923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:58.988260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:58.988629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:58.993697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719086b-6d8a-44ad-b278-11aa292e02c9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.000645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.002208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:47:59.019068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:59.020056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:47:59.020986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:47:59.020986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:47:59.020986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:59.025212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 440/866] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:47:59.026208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:59.044734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.045881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.046337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.047069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.048206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.049775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:59.063130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:59.064097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:47:59.065027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:47:59.066394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 427/867] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Sep 15 10:47:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:59.074067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:59.136853 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:59.162146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ff4d-4d99-49cf-a234-6613b2870934 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.204711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.205912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.206772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.207265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.208136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:59.208687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.210898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.224387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddf6f7-7183-4b11-b86e-3298cdd034a1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.225677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 441/868] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:59.231723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:59.266054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.267056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.267772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:59.268675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.269220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.270052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:59.270525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.272051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.278563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 428/869] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:47:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:59.283827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:59.342858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f3f3-9927-4a26-8794-7f7fc94829f9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.385443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.387314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.387768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.388482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.399092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.400644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.411143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:47:59.413749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:47:59.414637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:47:59.415511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:47:59.418938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb39d-28d0-4960-acd7-bc7486208277 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.420552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 442/870] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:47:59.422636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:59.473647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.474637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.475109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.475572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.476504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:59.477017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.478622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.492199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 429/871] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:47:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:47:59.546031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:47:59.553251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5926d-5da9-4790-ba58-e97304cf38aa None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.592711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.593388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.593619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.594018 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.594730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:59.595047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.596534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b88622-cd3c-45de-bf34-3957290c1bdb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.614566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 443/872] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:47:59.616107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:47:59.759140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216447a-ea18-4b56-a5d0-550c42f18a2c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:47:59.827937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:47:59.827937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:47:59.827937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:47:59.828763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:47:59.829672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=b4ecd6883cc643a59598254944fe52f4) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:47:59.830153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:47:59.831732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1598c-fc99-477b-a0a8-c9a946120f35 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:47:59.839644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 430/873] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:47:59 2022] GET /identity/v3/role_assignments?user.id=b4ecd6883cc643a59598254944fe52f4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:00.672064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775bb5-4e0b-4b0f-8c28-f6254bd56d96 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:00.672676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775bb5-4e0b-4b0f-8c28-f6254bd56d96 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:00.672676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5775bb5-4e0b-4b0f-8c28-f6254bd56d96 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:00.674312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 444/874] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:00.680111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:00.680608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:00.680712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:00.699332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:00.700565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:00.725023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:00.769304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9f3d2-e630-4917-ba4a-a385ec56e80c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:00.769640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9f3d2-e630-4917-ba4a-a385ec56e80c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:00.769865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9f3d2-e630-4917-ba4a-a385ec56e80c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:00.771198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 445/875] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:00.772833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 431/876] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:00.777399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:00.777786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:00.778104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:00.800852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:00.802051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:00.875237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 446/877] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:01.061880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.152216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.169034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf271-620a-403e-99a5-1200f8911b21 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.213339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.214210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.214497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.215094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.215956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.217993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:01.229024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:01.230177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:01.231239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 432/878] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:01.236864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.252331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:01.265060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038901e-b871-409c-bddc-35fe16f272bc None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.269255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:01.308291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.309354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.309855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.310345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.311130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.313436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:01.324772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:01.325815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:48:01.326659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:01.330518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 447/879] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:01.335885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.372335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130ba6-7276-4b6b-810a-c021c633ecba None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.419830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.421180 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.421661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.422596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.423712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:01.424398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.425787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.436208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 433/880] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:01.441391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.447222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8ea69-4b51-4a43-9e9e-9b4bcb3cbfb1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.493157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.493833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.494127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.494806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.496002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:01.496322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.498045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.507877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 448/881] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:01.509350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.526875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:01.545025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:01.559988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fdd38-2bd4-424b-85fc-0a625b192bd6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.602206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.603018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.603304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.603586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.604259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:01.605635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.607409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.618758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 434/882] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:01.630122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e5cc-f02f-4f74-b77d-0ddef0af0b80 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.670411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.671329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.671753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.672184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.673502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:01.673998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.675668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.682116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 449/883] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:01.688640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.809293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa55de-912b-484f-b192-05061908ef05 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:01.852292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:01.852855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.853139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.853418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.854123 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] RBAC: Adding query filter params (interface=public, service_id=0574093506254029b57252aa597d3134, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:01.854525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:01.856405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c880476-8325-4d73-be51-74071fa32e2f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:01.863302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 435/884] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/endpoints?service_id=0574093506254029b57252aa597d3134&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:01.869012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:01.936979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33209b89-5a22-4704-8941-99875ab7d59b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.937304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33209b89-5a22-4704-8941-99875ab7d59b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.937544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33209b89-5a22-4704-8941-99875ab7d59b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.939138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 436/885] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:01.943968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca5ca1-260a-4ed1-9e99-9c447107b5a6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:01.944523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca5ca1-260a-4ed1-9e99-9c447107b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:01.945000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca5ca1-260a-4ed1-9e99-9c447107b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:01.956632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:01.965319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-22ca5ca1-260a-4ed1-9e99-9c447107b5a6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:01.966767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-22ca5ca1-260a-4ed1-9e99-9c447107b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:01.977371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:01.978497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352532f0-39e6-4424-8b7a-44bf2666f8c2 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:02.013202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d4945-ac77-4c43-8ea8-7f84090032a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:02.013812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d4945-ac77-4c43-8ea8-7f84090032a0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:02.014087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d4945-ac77-4c43-8ea8-7f84090032a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:02.014358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d4945-ac77-4c43-8ea8-7f84090032a0 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:02.015224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d4945-ac77-4c43-8ea8-7f84090032a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:02.016300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d4945-ac77-4c43-8ea8-7f84090032a0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:02.022319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 450/886] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:48:01 2022] GET /identity/v3/services => generated 1011 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 10:48:02.056691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 437/887] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:02.272904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563f05-353f-49d4-985a-4206f6fc4888 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:02.273260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563f05-353f-49d4-985a-4206f6fc4888 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:02.273455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563f05-353f-49d4-985a-4206f6fc4888 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:02.275057 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 451/888] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:02.281098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:02.281379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:02.281651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:02.300667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:02.301886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:02.324036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563f05-353f-49d4-985a-4206f6fc4888 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:02.384834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 438/889] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:02.434500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563f05-353f-49d4-985a-4206f6fc4888 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:02.469950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:02.470550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:02.470826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:02.471097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:02.471754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:02.473121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:02.586022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 452/890] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:48:02 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:48:02.673068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:02.758920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:02.785651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87050d7e-5f10-4843-8965-bbe9e9aae56d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:02.828936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:02.829572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:02.829850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:02.830128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:02.841541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:02.846336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:02.847285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:02.848176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:02.852406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 439/891] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 15 10:48:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:02.853996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:02.857678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:02.960643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267c7b6-9aa5-4938-bfb1-63bca9bd7e2b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:02.997933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:02.998541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:02.998818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:02.999093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:02.999759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:03.000059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:03.001439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:03.013534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 453/892] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:48:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:03.016730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:03.126584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082c279-fbba-429d-9184-8816aedf196b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:03.158108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:03.164360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:03.165031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.165306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.172484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:03.175910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:03.177385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:03.191897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:03.193033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:03.193917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:03.193917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:03.193917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:03.193917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 440/893] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:03.200046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:03.269344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:03.309392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001564c1-c370-4685-a9e0-30837ad4a730 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:03.343335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:03.344339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.344825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.345301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:03.346145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:03.346651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:03.348211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:03.361035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 454/894] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:03.372342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:03.472812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a518e-b23e-4ef1-acdb-5ab13508e267 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:03.508165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:03.508839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.509160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.509439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:03.517186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:03.518614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:03.530385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:03.531314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:03.532258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 441/895] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:48:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:03.537436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:03.646618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c656-2ed7-49a4-bd2c-ebcb0430c900 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:03.671364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:03.682205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:03.682851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.683130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.683408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:03.684140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:03.684483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:03.685907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c0ac-df53-4e4d-910b-c9f16e1d5165 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:03.704080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 455/896] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 15 10:48:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:03.709253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:03.759029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:03.816125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd42ea5-ecfe-4a10-a6e4-3c4610fb5444 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:03.852241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:03.852913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.853199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.853473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:03.932814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:03.934653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:03.978170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:03.984134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e98f-dcde-4596-91dc-b0f7e9bc2a68 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.984674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e98f-dcde-4596-91dc-b0f7e9bc2a68 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.984862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e98f-dcde-4596-91dc-b0f7e9bc2a68 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:03.986332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 456/897] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:03.991772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:03.992039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:03.992331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.014105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:04.015664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:04.048175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 442/898] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:03 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 10:48:04.053883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.108119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 457/899] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:04.179434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb42ed-2311-400a-95ef-77a51bb84607 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:04.218087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:04.218793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.219084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.219360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.231251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:04.232768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:04.234877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b2ad3725-f466-4687-ab93-cd93a725f4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:04.253298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:04.254488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:04.255596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:04.255596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:04.255596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:04.257342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 443/900] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:04.263468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.332218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db300-4294-4583-b2a2-4d8bb538143b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.332481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db300-4294-4583-b2a2-4d8bb538143b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.332722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db300-4294-4583-b2a2-4d8bb538143b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.334185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 444/901] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:04.338946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.339230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.339502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.360010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:04.362267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:04.371214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73f449-94a1-4765-8061-ed08e5088893 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:04.384623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:04.408146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:04.408790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.409062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.409329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.410077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:04.410376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:04.411878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:04.424489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 458/902] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:04.424489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.452232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 445/903] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:04.453234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.557529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5335e-afc9-47fc-82f4-3a7dcf05e51f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:04.572653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764adac5-000e-42f1-9682-22e1e06c0d46 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:04.597661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:04.598616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.598884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:04.599709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.600192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.601299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:04.602902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:04.610867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:04.611490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.615373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.615373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.619277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:04.621169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:04.632527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:04.639147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 446/904] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:04.640030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.701600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 459/905] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:48:04 2022] POST /identity/v3/services => generated 241 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:04.727464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.765818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:04.779793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9fccc-aeff-4e86-b17f-2a04923396d6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:04.838132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:04.839850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.840737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.841175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.842515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:04.843237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:04.845450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:04.852420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac79ce-f42c-43ad-8c09-32e3a776b7b0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:04.863023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 447/906] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:04.869000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:04.903362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:04.903998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:04.904273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:04.904592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:04.905174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:04.906520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:04.919465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:04.920617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:04.921474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 460/907] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:04.926532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:04.927147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:05.001273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ea4a4-6ae0-4253-9ec8-7cf5dea8a1c4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:05.049937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:05.050929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:05.051665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.051947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.052476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.053136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] RBAC: Adding query filter params (role.id=2644dc977bad4e8394d5192d9bbab039, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=b4ecd6883cc643a59598254944fe52f4) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:05.053444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:05.054879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf901-126a-4f58-9f06-356911a8ad26 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:05.055632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda37d-b42b-4b71-9810-a9092d074b6e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:05.065075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 448/908] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/role_assignments?user.id=b4ecd6883cc643a59598254944fe52f4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=2644dc977bad4e8394d5192d9bbab039 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:05.065075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57f79-d261-4fe4-b0ed-4bca54912196 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.065075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57f79-d261-4fe4-b0ed-4bca54912196 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.065075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57f79-d261-4fe4-b0ed-4bca54912196 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.065075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 449/909] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:05.078700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.079366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.079887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.099455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:05.100893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:05.103675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:05.104625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.105365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.105859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.106721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:05.107179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:05.108850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:05.114958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 461/910] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:48:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:05.121721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:05.208705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 450/911] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:05.252009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f345-d388-4b41-809d-04cbc37d5cd5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:05.286817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:05.287425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.287704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.287979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.288639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:05.288942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:05.290479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:05.296839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 462/912] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Sep 15 10:48:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:05.302454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:05.340999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:05.411374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ade4-0045-4477-a172-3648590a1e4a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:05.449997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:05.450610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.450890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.451163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.451896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:05.453289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:05.501730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:05.528868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:05.560593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 451/913] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:48:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:05.628520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f833490-59b4-418b-bd7f-365d70aa0783 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:05.673225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:05.673908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.674188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.674456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.675059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:05.676524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:05.686707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:05.687733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:05.688873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 463/914] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Sep 15 10:48:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:05.697375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:05.797458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:05.806609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf8c5e-0008-42d8-88f6-a4bc0a2e3888 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:05.843160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:05.843784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:05.844286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:05.844918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:05.845558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:05.846435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:05.847983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:05.858031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 452/915] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:05.859389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:05.954615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:05.971456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723306-be1a-43bd-a29c-c82149eae19d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:06.007654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:06.008261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:06.008569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:06.008844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:06.009472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:06.009777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:06.012076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:06.020726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 464/916] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:06.023469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:06.134313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542217c3-95c2-4729-8e6f-de3590be3513 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:06.169488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:06.170107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:06.170388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:06.170665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:06.171370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] RBAC: Adding query filter params (interface=public, service_id=a722e1cdd5d2433f83b1aee435fd2993, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:06.171680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:06.173120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d7fa-247e-4c31-a3da-a06965cb5590 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:06.181879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 453/917] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:48:06 2022] GET /identity/v3/endpoints?service_id=a722e1cdd5d2433f83b1aee435fd2993&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:06.185155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:06.286646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b82b-d768-4b7d-981b-05664b72f5ed None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:06.322347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067ff9d-332b-4ef5-aabf-adfcb3aa9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:06.323841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ff9d-332b-4ef5-aabf-adfcb3aa9142 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:06.324133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ff9d-332b-4ef5-aabf-adfcb3aa9142 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:06.324438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ff9d-332b-4ef5-aabf-adfcb3aa9142 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:06.325041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ff9d-332b-4ef5-aabf-adfcb3aa9142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:06.326452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ff9d-332b-4ef5-aabf-adfcb3aa9142 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:06.336458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 465/918] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:48:06 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 10:48:07.005794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79277551-d595-4045-a2b1-0d7a58574be9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.006451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79277551-d595-4045-a2b1-0d7a58574be9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.006451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79277551-d595-4045-a2b1-0d7a58574be9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.007922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 454/919] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:07.013963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd62db-cf06-460f-b67b-d7677b036f20 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.014254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd62db-cf06-460f-b67b-d7677b036f20 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.014533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd62db-cf06-460f-b67b-d7677b036f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.034369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-bbfd62db-cf06-460f-b67b-d7677b036f20 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:07.035564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bbfd62db-cf06-460f-b67b-d7677b036f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:07.043433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:07.110591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 466/920] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:07.356342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64341-75f7-43ac-835a-1ed05aa4cc07 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.356983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64341-75f7-43ac-835a-1ed05aa4cc07 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.357473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64341-75f7-43ac-835a-1ed05aa4cc07 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.359268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 455/921] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:07.364531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.365383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.366128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.382768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa64341-75f7-43ac-835a-1ed05aa4cc07 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:07.388139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:07.389577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:07.410251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:07.484401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 467/922] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:07.520970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa64341-75f7-43ac-835a-1ed05aa4cc07 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:07.556543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:07.557248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.557668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.558227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.558917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:07.560365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:07.569711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:07.570782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:07.571721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 456/923] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:07.578100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:07.651482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:07.681946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1b50-5c0f-40d9-a4a8-ddfe63018e98 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:07.717662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:07.718271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.718548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.718814 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.719433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:07.719731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:07.721095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:07.726154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 468/924] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:07.732240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:07.803082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:07.828639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:07.853475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd50286-dc02-484e-9077-b92f1e8398bf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:07.900801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:07.901731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.901987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.902266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.902902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:07.903278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:07.904568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf62f6-6040-4e84-86ce-b56fa27fabe8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:07.909532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 457/925] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:07.910507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2101e-1051-4b42-ab37-eb1bc46437e1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.910785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2101e-1051-4b42-ab37-eb1bc46437e1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.911056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2101e-1051-4b42-ab37-eb1bc46437e1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.912364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 458/926] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:07.916866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2101e-1051-4b42-ab37-eb1bc46437e1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:07.926288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771e44b-01b2-4b93-8aa8-e316b5c78f03 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:07.963346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bb10f-235a-41cc-bbdb-5e48e6bf2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:07.964035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bb10f-235a-41cc-bbdb-5e48e6bf2cbe None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.964340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bb10f-235a-41cc-bbdb-5e48e6bf2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.964682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bb10f-235a-41cc-bbdb-5e48e6bf2cbe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:07.968324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:07.977115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bb10f-235a-41cc-bbdb-5e48e6bf2cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-f77bb10f-235a-41cc-bbdb-5e48e6bf2cbe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:07.983522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:07.984515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 469/927] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 15 10:48:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:07.989376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:07.990192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:07.990192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.008815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:08.010311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:08.030898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2101e-1051-4b42-ab37-eb1bc46437e1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.065867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.066479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.066782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.067031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.067752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] RBAC: Adding query filter params (interface=public, service_id=d2f65e1d79354704ab70ff2b6a55a58c, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:08.068338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.069439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.075007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 459/928] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:48:07 2022] GET /identity/v3/endpoints?service_id=d2f65e1d79354704ab70ff2b6a55a58c&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:08.080256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.082689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 470/929] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:08.093624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:08.094575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.202208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b2422-0b84-4537-bbf0-9888099f600a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.240130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f11f32-1cc2-45d5-987b-8b9230029102 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.241175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.242048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.242542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.243024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.243910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:08.244465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.246596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.256088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 460/930] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:08.262539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.278966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:08.288911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.289769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.290427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.290906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.292835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.294438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.308337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 471/931] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 10:48:08.351428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.362913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:08.395703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd269899-104d-4ce1-8981-840332addf91 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.437694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.438448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.438797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.439065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.451942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.453628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:08.469251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:08.470351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:08.471276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:08.471276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:08.471276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:08.471276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 461/932] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:08.477748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.503668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dbe3b-9b1d-4a55-a677-3ddb993d3c9e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.545079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.546998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.547277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.547553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.548243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.549635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.554964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING keystone.server.flask.common [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 10:48:08.610617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.sql.core [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 10:48:08.610617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 10:48:08.610617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [parameters: {'id': '5ce874281b034d8a8ef8afc00435fbea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 10:48:08.610617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81565) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 10:48:08.611019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd9139-50af-4177-b01c-89b7d40a083b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9901f126-bdc6-405b-a703-fec99de36af5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ce874281b034d8a8ef8afc00435fbea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ce874281b034d8a8ef8afc00435fbea. Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application conn.query(q) Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 10:48:08.632586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result.read() Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 10:48:08.633493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application next(self.gen) Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application yield resource Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application next(self.gen) Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise self.value Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application session.commit() Sep 15 10:48:08.634514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.session.flush() Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application compat.raise_( Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 10:48:08.635478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 10:48:08.636741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application conn.query(q) Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result.read() Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 10:48:08.637557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [parameters: {'id': '5ce874281b034d8a8ef8afc00435fbea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.638439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:08.639229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ce874281b034d8a8ef8afc00435fbea. Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 472/933] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Sep 15 10:48:08 2022] POST /identity/v3/projects => generated 262 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524af7-0de1-48bd-85ed-b89deb0e42bf None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.640166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524af7-0de1-48bd-85ed-b89deb0e42bf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.642540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45524af7-0de1-48bd-85ed-b89deb0e42bf None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.642631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:08.644568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 473/934] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:08.645356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45524af7-0de1-48bd-85ed-b89deb0e42bf None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.655572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.656184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.656584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.656863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.657579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:08.657882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.659286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64309f49-7bc5-4534-a5a4-7a6bd92c0d1c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.671777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 462/935] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:08.673010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.673290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.673599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.696630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:08.697990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:08.702755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:08.757885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45524af7-0de1-48bd-85ed-b89deb0e42bf None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.770349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 463/936] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:08.770990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.802868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.804098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.804977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.805974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.816565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.818397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:08.836151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:08.837167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:08.838080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:08.841512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 474/937] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:08.846573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.895352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e5e0-86a4-468e-b49d-1b6cb65f5a79 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.911770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:08.937529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:08.938186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:08.938861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:08.939137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:08.948668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:08.950150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:08.967233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:08.968231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:48:08.969248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:08.970614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 464/938] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:08.975914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620cc81-7ca5-4fca-ae96-17fdf4683057 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:08.976073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:08.981928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:09.009606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.010203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.011070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.011322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.011984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:09.012282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.013720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.043251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 475/939] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:09.044111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.092607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd964e-429d-40f0-abca-a904740f613f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.134281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.135305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.135959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.136521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.137448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:09.137914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.139776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.154932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd528d-577b-4697-930e-ca09d90d9e59 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.161169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 465/940] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 15 10:48:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:09.167178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.210125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.211126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.211779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.213121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.214182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.215769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.220694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:09.227846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:09.228858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 10:48:09.230297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:09.233534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 476/941] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:09.239257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.279040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:09.294900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b706e1-f330-4fa1-be58-6dd14250e767 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.339433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.340131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.340406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.340786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.353452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.355791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.364146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130408-d524-4954-8dbd-ca64e00a030e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:09.371789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:09.372952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:09.373938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:09.373938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:09.373938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:09.373938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 466/942] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:09.378522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.406849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.407659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.408288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.408793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.409567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:09.409946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.411360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.418162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 477/943] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:09.427192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.484288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:09.502666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf5dc-1c6f-42bc-8737-9f96dba0dad1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.545025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:09.546825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.547659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.548180 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.548702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.549561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:09.550065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.551624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.551910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f03388-cf9b-4b28-aaa6-4a39bd5ad6f5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.565537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 467/944] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:09.570849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.593220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.593841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.594124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.594401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.595045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:09.595355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.596838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.602282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 478/945] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:09.608777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.691527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d11ec-ccdd-4c65-bfcd-d9acde0ba5f0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.723587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364125e-4f25-49fb-8a6b-be00610ec0de None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.729178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.729988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.730370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.730747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.738069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.739632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:09.752354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:09.753436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:09.754518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:09.761414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 468/946] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:09.762973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.769133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:09.772808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.773536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.773903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.774271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.775429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.777010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.872678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090526-ab21-4e2f-a299-38c7692091d9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:09.879097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 479/947] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:48:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:48:09.923373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:09.924036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:09.924333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:09.924668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:09.925365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:09.925669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:09.927222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa2eda-4587-4309-87af-e8721726bcbd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:09.942440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 469/948] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:09.948747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:09.967549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:10.071378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf1f05-2f10-42b3-a30c-06b7a521a15d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:10.107940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f3e8b-4c59-4250-b0d2-b15d5a8eba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:10.108635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3e8b-4c59-4250-b0d2-b15d5a8eba75 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:10.108968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3e8b-4c59-4250-b0d2-b15d5a8eba75 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:10.109248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3e8b-4c59-4250-b0d2-b15d5a8eba75 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/b4ecd6883cc643a59598254944fe52f4/roles/2644dc977bad4e8394d5192d9bbab039` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:10.111398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f3e8b-4c59-4250-b0d2-b15d5a8eba75 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=b4ecd6883cc643a59598254944fe52f4, role_id=2644dc977bad4e8394d5192d9bbab039)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:10.112868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f3e8b-4c59-4250-b0d2-b15d5a8eba75 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:10.179457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 480/949] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:48:09 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/b4ecd6883cc643a59598254944fe52f4/roles/2644dc977bad4e8394d5192d9bbab039 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:48:10.691185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6d876-edea-414f-af5b-7f8090fd4336 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:10.691739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6d876-edea-414f-af5b-7f8090fd4336 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:10.691739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6d876-edea-414f-af5b-7f8090fd4336 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:10.693359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 470/950] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:10.699423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:10.699836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:10.700019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:10.718917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:10.720441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:10.789797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 481/951] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:11.062968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6d876-edea-414f-af5b-7f8090fd4336 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:11.130922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:11.173946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6d876-edea-414f-af5b-7f8090fd4336 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:11.210226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:11.211196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.211701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.212178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.212979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:11.215101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-222f41ca-32fe-4201-89a4-b6c100df88e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:11.224124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:11.225264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:11.226165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:11.228892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 471/952] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:11.234852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:11.258267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:11.341347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679070cd-1b10-43ee-8e4d-3332730a9396 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:11.368603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150bd7-34c5-412b-ad7b-a49169193ad8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.368887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150bd7-34c5-412b-ad7b-a49169193ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.369169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150bd7-34c5-412b-ad7b-a49169193ad8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.370824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 472/953] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:11.375684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.375970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.376249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.377740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:11.378544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.379010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.379449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.380236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:11.380746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:11.382411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:11.392477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 482/954] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:11.400562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:11.400562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:11.400764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:11.470555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:11.480547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 473/955] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:11.506228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6a37-764d-495c-8aaa-8587c4aeabd9 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:11.540661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:11.541272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.542087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.542362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.542980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:11.543276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:11.544781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:11.553616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 483/956] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:11.555766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:11.613149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:11.659256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec678d-a2cf-4d62-a292-98e37b4b7b55 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:11.694422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:11.695043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.695320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.695571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.696243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:11.697629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:11.766400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:11.788341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 474/957] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:48:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:11.890332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973bba-e66c-4ef2-b66d-eca47de830e1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:11.923328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:11.935058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:11.940941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:11.940941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:11.940941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:11.940941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:11.940941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:11.987997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.sql.core [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 10:48:11.987997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 10:48:11.987997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [parameters: {'user_id': '1292c6385c7d497ab31e2436db2f2c22', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 10:48:11.987997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81565) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-43a9cb6a-508f-46e6-a901-a10d98ea1e8c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application conn.query(q) Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result.read() Sep 15 10:48:11.995793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 10:48:11.996787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application next(self.gen) Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application yield resource Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application next(self.gen) Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise self.value Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application session.commit() Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 10:48:11.997805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.session.flush() Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application compat.raise_( Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 10:48:11.998751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 10:48:11.999655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application conn.query(q) Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application result.read() Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 10:48:12.001807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [parameters: {'user_id': '1292c6385c7d497ab31e2436db2f2c22', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:12.004041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 10:48:12.006174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:12.008727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 484/958] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Sep 15 10:48:11 2022] POST /identity/v3/users => generated 160 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:12.011776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:12.131906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b0180-34da-4fae-bce7-b7351b003426 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:12.148391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:12.150837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d21c1-eca0-4990-805b-e127902aa4e2 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.151328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d21c1-eca0-4990-805b-e127902aa4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.151816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d21c1-eca0-4990-805b-e127902aa4e2 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.156241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 485/959] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:12.161738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee3f82-7cf0-4f18-ac59-2eee358b6132 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.162023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee3f82-7cf0-4f18-ac59-2eee358b6132 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.164875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee3f82-7cf0-4f18-ac59-2eee358b6132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.174849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:12.175489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.175766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.176036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.184572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:12.185625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-93ee3f82-7cf0-4f18-ac59-2eee358b6132 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:12.186035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:12.187534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-93ee3f82-7cf0-4f18-ac59-2eee358b6132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:12.198257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:12.199271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:12.200225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 475/960] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:48:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:12.205733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:12.284404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 486/961] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:12.332636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac469a0b-64d9-44ac-9021-8eb0a206a958 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:12.367972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:12.368614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.368889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.369159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.370386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:12.370684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:12.372299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169c7b8-71be-485b-86d7-43b47d8c0399 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:12.416656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 476/962] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Sep 15 10:48:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:12.513927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69998-2b25-4085-b070-a1fe78f8068a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.514275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69998-2b25-4085-b070-a1fe78f8068a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.514481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69998-2b25-4085-b070-a1fe78f8068a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.516101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 487/963] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:12.521736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.522022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.522296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.543146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:12.544391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:12.564864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69998-2b25-4085-b070-a1fe78f8068a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:12.575672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:12.639799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 477/964] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:12.685215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69998-2b25-4085-b070-a1fe78f8068a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:12.707100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:12.722669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:12.723306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.723583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.723855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.724465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:12.726000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:12.736697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:12.737768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:12.738717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 488/965] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:12.744742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:12.852619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468621c-c19f-4d5a-a662-fadeebc1b7ca None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:12.886434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:12.887033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:12.887310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:12.887584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:12.888214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:12.888594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:12.890003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:12.899290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 478/966] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:12.900242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:12.927182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:12.953706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:13.006931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589e09-5a5d-4f48-a17c-13ed3f14fa37 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.035319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd0837-db5f-445e-95f0-8370ade0cde7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.049534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.050255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.050531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.050887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.051423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:13.051723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:13.053442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:13.068608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 489/967] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:13.082656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.083399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.083745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.084109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.097176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:13.102315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:13.103288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:13.104297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:13.108570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 479/968] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 15 10:48:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:13.109913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:13.166580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:13.222851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46275-a444-4d75-967d-50961c0024dc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.259489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.261000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.261450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.261875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.262699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:13.263152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:13.264686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:13.273385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 490/969] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:48:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:13.279011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:13.362119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:13.381454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c058e-cf93-4bc6-be8d-ef42ad88150f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.416701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.417413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.417696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.417976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.428263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:13.429820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:13.445280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:13.446235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:13.452125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:13.452125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:13.452125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:13.452125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 480/970] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:13.453939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:13.558940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811dc4c-6d2b-445b-9f31-a1757783dd96 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.569459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:13.593720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.594327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.594607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.594883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.595526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:13.595830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:13.597214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:13.614935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 491/971] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:13.616652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:13.720634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce824-b837-4531-8e68-886bb3ef6274 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.754638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.755306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.755542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.755810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.757764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:13.765980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:13.767432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:13.779355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:13.780322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 10:48:13.781856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:13.782889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 481/972] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:48:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:13.786247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:13.889394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f35e-ee9a-4ec3-964e-5793672b7615 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:13.923553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:13.924230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:13.924507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:13.924730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:13.925467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:13.925768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:13.927219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b5e7-6658-4f4e-99f7-ec252d234928 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:13.952283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 492/973] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Sep 15 10:48:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:13.953515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.061295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c30a77-08cd-44ce-bc8c-1eb37213e20b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.096248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.097025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.097423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.097794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.113149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c59e7b-3a9a-4cf0-874b-41444e72c5bd None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.113520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c59e7b-3a9a-4cf0-874b-41444e72c5bd None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.113862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c59e7b-3a9a-4cf0-874b-41444e72c5bd None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.115441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 493/974] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:14.121084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.121376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.121650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.140421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:14.141542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:14.164743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:14.165827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:14.173258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.174761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.216159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 494/975] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:14.285268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 482/976] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:13 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:48:14.290921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.391612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d093390-431b-456f-a41e-91ce79aef5ef None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.425124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.425748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.426028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.426302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.436193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.437642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:14.452559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:14.453576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:14.459489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:14.459489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:14.459489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:14.459489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 495/977] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:14.459732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.497098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.511010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:14.574271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:14.582127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb4e63-2c23-4369-835c-fd643521da95 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.615469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9ab8-7a83-479d-a3da-22385a64961e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.624611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.625238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.625711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.626183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.627316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:14.632256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.637445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.655627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 483/978] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:14.657294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.661086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.661721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.662000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.662279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.662865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.664213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:14.675638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:14.676693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:14.679258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 496/979] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:14.682688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.762192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:14.770788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624337-0854-4395-9cf6-4999fe6930e5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.789538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c98f-cbf2-43a6-ad52-77df2762a3ac None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.805536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.806154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.806430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.806700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.814251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.815787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:14.827841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:14.828808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:14.829731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 484/980] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:14.831089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.831700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.831992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.832255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.832920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:14.833226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.834573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.834675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.844467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 497/981] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:14.846765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:14.852548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:14.946305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8952fb-228c-409e-b6c1-391b3f7f4ab7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.952873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b85c-e84a-43b0-bb63-7f69cba81eaa None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:14.983896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.984672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.985091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.985473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.986229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:14.986623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.988125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.988392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:14.989000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:14.989282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:14.989561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:14.990308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:14.990610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:14.992360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:14.997557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 498/982] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:15.001279 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 485/983] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:15.003100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:15.005857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:15.007746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:15.094426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:15.110504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52c9e2-1ed3-4ccd-a4fd-d962465d42cc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:15.122339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de54028-83aa-457b-90c1-70fc0435a00f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:15.152575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:15.153192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:15.153555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:15.153738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:15.154481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] RBAC: Adding query filter params (interface=admin, service_id=d2f65e1d79354704ab70ff2b6a55a58c, region_id=RegionOne) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:15.154969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:15.156141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:15.166126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 499/984] 10.222.0.26 () {56 vars in 1249 bytes} [Thu Sep 15 10:48:15 2022] GET /identity/v3/endpoints?service_id=d2f65e1d79354704ab70ff2b6a55a58c&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:15.167515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:15.167720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:15.168428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:15.168770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:15.169116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:15.169905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] RBAC: Adding query filter params (role.id=2644dc977bad4e8394d5192d9bbab039, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=b4ecd6883cc643a59598254944fe52f4) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:15.170281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:15.171702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122e261-318d-40d7-b62b-05fa316cce6b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:15.177765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 486/985] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:15 2022] GET /identity/v3/role_assignments?user.id=b4ecd6883cc643a59598254944fe52f4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=2644dc977bad4e8394d5192d9bbab039 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:15.253202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130bd4b-51dd-46b6-a32a-af4c8d51c3eb None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:15.253491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130bd4b-51dd-46b6-a32a-af4c8d51c3eb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:15.253683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130bd4b-51dd-46b6-a32a-af4c8d51c3eb None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:15.255043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 487/986] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:15.261698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b79d-c492-42cd-98b1-64f911e1d267 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:15.262302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:15.262903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b79d-c492-42cd-98b1-64f911e1d267 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:15.263184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b79d-c492-42cd-98b1-64f911e1d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:15.282894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7723b79d-c492-42cd-98b1-64f911e1d267 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:15.284093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7723b79d-c492-42cd-98b1-64f911e1d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:15.303159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869b711-bb9c-4f54-aba7-8f1c0385583e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:15.342701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:15.343330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:15.343608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:15.343882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:15.344522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:15.346088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:15.360423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 500/987] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:48:15 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 10:48:15.360625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 488/988] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:15.631011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:15.737045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b687d-6d8b-451a-96ef-881697f1ab03 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:15.766188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:15.771847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07daa-a525-46bb-9c8c-ebe767ae814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:15.772486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07daa-a525-46bb-9c8c-ebe767ae814e None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:15.772771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07daa-a525-46bb-9c8c-ebe767ae814e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:15.773047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07daa-a525-46bb-9c8c-ebe767ae814e None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:15.773788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07daa-a525-46bb-9c8c-ebe767ae814e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:15.775066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07daa-a525-46bb-9c8c-ebe767ae814e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:15.886667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 501/989] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:48:15 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:17.427008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a208-3402-40e0-86be-a5de2e17bb4e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:17.427534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a208-3402-40e0-86be-a5de2e17bb4e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:17.427645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a208-3402-40e0-86be-a5de2e17bb4e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:17.429068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 489/990] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:17.434956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:17.435396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:17.435489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:17.454427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:17.455598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:17.500988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c34f6-cd8a-4de7-8a1b-c74bc061327f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:17.501657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c34f6-cd8a-4de7-8a1b-c74bc061327f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:17.501942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c34f6-cd8a-4de7-8a1b-c74bc061327f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:17.503274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 490/991] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:17.508235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:17.508552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:17.508832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:17.528049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:17.529253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:17.534663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 502/992] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:17.602321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:17.608058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 491/993] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:17.806408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:17.877628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:17.912222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864bf54-0731-4b90-9944-4fcbe225e4a3 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:17.930132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:17.950378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:17.951160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:17.951438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:17.951718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] PATH_INFO: `/v3/services/image` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:17.952326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:17.953678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:17.963819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:17.965410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:17.966287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 503/994] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Sep 15 10:48:17 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:17.970748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:17.989917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477702a2-f335-4458-a4af-ab0542406a13 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.035716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.036736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.037023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.037576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.038169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.040164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:18.053392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:18.054391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 10:48:18.055229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:18.057036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 492/995] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Sep 15 10:48:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:18.060846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.089600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e26df-e28a-4796-a7bf-a442a2e64c77 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.123465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.124064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.124358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.124630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.125243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] RBAC: Adding query filter params (name=image) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:18.125540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.126908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c028727-4bab-4731-8ddc-e7b5e088a082 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.128073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:18.132244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 504/996] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:18.133406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b0cc-a1cf-4774-ba42-86c04f324c1c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.133689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b0cc-a1cf-4774-ba42-86c04f324c1c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.134013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b0cc-a1cf-4774-ba42-86c04f324c1c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.135836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 505/997] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:18.138323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96b0cc-a1cf-4774-ba42-86c04f324c1c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.168868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcad66-f1e7-4ed3-8baa-9073ed816b01 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.184122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:18.202204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.202905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.203120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.203390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.204016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:18.204330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.205729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d25560-57b4-4e9b-a6c1-323eb8db0c06 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.210536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 493/998] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:18.211669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.211951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.212226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.230670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:18.231844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:18.238696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96b0cc-a1cf-4774-ba42-86c04f324c1c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.272020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.272649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.272929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.273202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.273828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] RBAC: Adding query filter params (type=image) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:18.274127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.275467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.280388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 506/999] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:18.283703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.302957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 494/1000] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:18.388970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29c7e4-2bc1-497c-91c2-d60ce359b59c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.398615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:18.425080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.425721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.425989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.426265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.426903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:18.427206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.428920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.440155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 507/1001] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Sep 15 10:48:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:18.441344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.504115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:18.551553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487f96-1219-4986-9fcc-e2b46354dcbe None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.589217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.589741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.589887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.590153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.590371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.591040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.592440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.699783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 495/1002] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:48:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:18.702033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f91a10-1a26-4cfc-95d0-0253892a03ae None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.749473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.750116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.750394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.750671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.751255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.752685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:18.763369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:18.764826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:18.766082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 508/1003] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:18.772294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.895357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db4715-5539-4c6b-a7fd-00872d69d9c0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:18.914846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:18.935363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:18.935986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:18.936273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:18.936670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:18.937322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:18.937630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:18.939022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:18.944172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 496/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:18.951158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:18.984589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:19.060437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d9f3-8b2c-43b3-bdb0-c6ac46b46700 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:19.095456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:19.096164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:19.096556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:19.096842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:19.097475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:19.097781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:19.099140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:19.109109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 509/1005] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:19.110255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:19.219900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e371d6-4fbb-4d4f-aae9-8444210601d5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:19.254956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:19.255570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:19.255855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:19.256134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:19.256868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] RBAC: Adding query filter params (interface=public, service_id=5f032d491a6b4bdcac11c267dd64f84d, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:19.257184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:19.258546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210f1f-e07c-4aef-b78c-76e7fa0c2c53 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:19.268213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 497/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:48:19 2022] GET /identity/v3/endpoints?service_id=5f032d491a6b4bdcac11c267dd64f84d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:19.269513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:19.366401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:19.373744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7709-802b-43ed-903b-44b3cf4b28e0 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:19.407573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9f415-8684-4728-b803-4c3475cf0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:19.408175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9f415-8684-4728-b803-4c3475cf0650 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:19.408484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9f415-8684-4728-b803-4c3475cf0650 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:19.408754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9f415-8684-4728-b803-4c3475cf0650 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:19.409356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9f415-8684-4728-b803-4c3475cf0650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:19.411366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9f415-8684-4728-b803-4c3475cf0650 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:19.418688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 510/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:48:19 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 10:48:20.471259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb4d2-55d2-4f4b-a0d0-639158321a41 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:20.471815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb4d2-55d2-4f4b-a0d0-639158321a41 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:20.471815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb4d2-55d2-4f4b-a0d0-639158321a41 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:20.473304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 498/1008] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:20.478303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f265c-d3fa-4ef1-81e8-98155f48fa09 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:20.479252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f265c-d3fa-4ef1-81e8-98155f48fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:20.479619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f265c-d3fa-4ef1-81e8-98155f48fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:20.498790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5a1f265c-d3fa-4ef1-81e8-98155f48fa09 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:20.499960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5a1f265c-d3fa-4ef1-81e8-98155f48fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:20.567961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 511/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:20.847113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcb4d2-55d2-4f4b-a0d0-639158321a41 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:20.895787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:20.926436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24189e7b-4b87-4ada-b2b2-feb1c5f747c2 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:20.926754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24189e7b-4b87-4ada-b2b2-feb1c5f747c2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:20.927001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24189e7b-4b87-4ada-b2b2-feb1c5f747c2 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:20.928487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 512/1010] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:20.933517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:20.933794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:20.934092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:20.952626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:20.953805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:20.963741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcb4d2-55d2-4f4b-a0d0-639158321a41 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:20.998676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:20.999292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:20.999577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:20.999855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:21.000556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:21.001919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:21.024320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 513/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:21.076725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 499/1012] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:48:20 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:21.298387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:21.320540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:21.398380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028f5f7-8df2-44b6-b5c4-bcec41d1fed3 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:21.439019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655901-1382-448e-9658-7173240d4f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:21.439653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655901-1382-448e-9658-7173240d4f07 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:21.439933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655901-1382-448e-9658-7173240d4f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:21.440206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655901-1382-448e-9658-7173240d4f07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:21.441339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655901-1382-448e-9658-7173240d4f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:21.442747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655901-1382-448e-9658-7173240d4f07 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:21.444484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 514/1013] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:21.450185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:21.557926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a541753-939d-49bb-899a-f03e06b597ee None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:21.560527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:21.594982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:21.595596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:21.595879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:21.596157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:21.596380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e028b-1f66-468d-a184-31dbb7f1762d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:21.596820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e028b-1f66-468d-a184-31dbb7f1762d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:21.596897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:21.596979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e028b-1f66-468d-a184-31dbb7f1762d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:21.598294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 515/1014] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:21.598466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:21.603099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:21.603380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:21.603700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:21.623861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:21.625096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:21.693154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 516/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:21.720333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 500/1016] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:48:21 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:21.966415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:21.983966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:22.075807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301638-e82c-4404-b0c6-4b15cff375e2 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:22.110610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:22.111235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:22.111512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:22.111864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:22.112474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:22.113829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:22.123541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:22.124599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:22.125470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 517/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:22.132178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:22.233264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ff04c-02c7-4031-964f-d18d36f4698e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:22.269620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:22.270239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:22.270523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:22.270801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:22.271433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:22.271737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:22.273136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:22.279483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 501/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:22.284275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:22.367303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:22.389043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5001-0e37-420b-a276-c43c43507e19 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:22.422834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:22.423437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:22.423736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:22.424013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:22.424667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:22.424971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:22.426319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047caf9f-a538-4876-ba25-3ac3b6007199 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:22.436367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 518/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Sep 15 10:48:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:22.437485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:22.460323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:22.540848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4debe6a-5d46-4ce4-bf9e-969064286d6e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:22.575291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1d7a3-595c-43cb-8a4b-d8095932a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:22.575927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d7a3-595c-43cb-8a4b-d8095932a149 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:22.576159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d7a3-595c-43cb-8a4b-d8095932a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:22.576459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d7a3-595c-43cb-8a4b-d8095932a149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:22.577122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d7a3-595c-43cb-8a4b-d8095932a149 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:22.578481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1d7a3-595c-43cb-8a4b-d8095932a149 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:22.684495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 502/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:48:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:23.268290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10362a-224d-4bf2-af04-e90a034a3651 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:23.268893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10362a-224d-4bf2-af04-e90a034a3651 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:23.268893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10362a-224d-4bf2-af04-e90a034a3651 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:23.270212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 519/1021] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:23.275496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:23.275837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:23.276117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:23.294628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:23.295776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:23.368973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 503/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:23.640592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10362a-224d-4bf2-af04-e90a034a3651 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:23.745937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10362a-224d-4bf2-af04-e90a034a3651 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:23.779331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:23.779957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:23.780240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:23.780543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] PATH_INFO: `/v3/services/image` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:23.781122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:23.782461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-62046d5e-2c24-42d5-9de0-547463a41435 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:23.791339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:23.797265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:23.798909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 520/1023] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Sep 15 10:48:23 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:23.800735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:23.803095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:23.910472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b1c3e-83ec-488c-a946-de1fbcff5e77 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:23.945461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:23.946065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:23.946343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:23.946616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:23.947324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] RBAC: Adding query filter params (name=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:23.947635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:23.949147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:23.953846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5f8e-ea76-4eb9-9d77-d2c544b62f1d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:23.958855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5f8e-ea76-4eb9-9d77-d2c544b62f1d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:23.958988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 504/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:23.959072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5f8e-ea76-4eb9-9d77-d2c544b62f1d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:23.959072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 521/1025] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:23.959617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:23.960637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:23.960924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:23.961215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:23.974361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:23.981764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:23.982935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:24.030157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:24.059944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 522/1026] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:24.068356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93345499-2093-4222-858f-7e03f64b9905 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:24.103074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:24.103746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.104036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.104498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.105129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] RBAC: Adding query filter params (type=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:24.105429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:24.106778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:24.116944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 505/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:24.117764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:24.213554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d8275-7b05-47be-a1cb-d72192cd5999 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:24.245981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:24.246573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.246849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.247119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.247803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] RBAC: Adding query filter params (interface=public, service_id=6366312a662b4cd0b4d9ec4da8fea239, region_id=RegionOne) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:24.248105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:24.249468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:24.251752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:24.260193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 523/1028] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:48:24 2022] GET /identity/v3/endpoints?service_id=6366312a662b4cd0b4d9ec4da8fea239&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:24.262291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:24.329758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:24.362667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749caa5-c7b0-493c-bc39-55f9b15de779 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:24.394037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:24.399978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:24.405515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.405515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.405515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.405515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:24.405515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:24.410829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 506/1029] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:48:24 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 10:48:24.444084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9f07-32f9-4f73-8c0d-99199a5c4c93 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:24.483068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7d92c-a8b9-4bf3-ad55-799344e7cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:24.483625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d92c-a8b9-4bf3-ad55-799344e7cb73 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.483907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d92c-a8b9-4bf3-ad55-799344e7cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.484179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7d92c-a8b9-4bf3-ad55-799344e7cb73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.485392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d92c-a8b9-4bf3-ad55-799344e7cb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:24.486832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7d92c-a8b9-4bf3-ad55-799344e7cb73 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:24.488730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 524/1030] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:24.495540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:24.605669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287105fb-15e9-44ee-9e86-c726256dfccd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:24.640639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa3777-634e-4225-9be8-b398d11d05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:24.641244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa3777-634e-4225-9be8-b398d11d05f6 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.641519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa3777-634e-4225-9be8-b398d11d05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.641789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa3777-634e-4225-9be8-b398d11d05f6 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.642437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa3777-634e-4225-9be8-b398d11d05f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:24.643850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa3777-634e-4225-9be8-b398d11d05f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:24.755791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 507/1031] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:48:24 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:24.970917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27f02-d40c-424b-9ed0-a43bba24df56 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.971201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27f02-d40c-424b-9ed0-a43bba24df56 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.971484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27f02-d40c-424b-9ed0-a43bba24df56 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.973023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 525/1032] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:24.978903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:24.979357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:24.979448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:24.998703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:24.999892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:25.053900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:25.075274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 508/1033] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:25.343033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea27f02-d40c-424b-9ed0-a43bba24df56 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:25.412949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:25.446159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea27f02-d40c-424b-9ed0-a43bba24df56 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:25.480017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:25.480698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:25.480979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:25.481251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:25.491490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:25.496400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:25.497305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:25.501273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 526/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 15 10:48:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:25.503411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:25.609492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5023f-b22e-436b-b04f-e65a5acaa1f7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:25.647243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:25.647857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:25.648139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:25.648473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:25.649146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:25.649453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:25.651489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:25.664447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 509/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:48:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:25.665565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:25.767868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2292a47-e1a2-40df-a415-3de6e030ea87 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:25.793795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:25.801755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:25.802382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:25.802662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:25.802938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:25.812942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:25.814370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:25.829165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:25.830106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:25.830999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:25.830999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:25.830999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:25.830999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 527/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:25.837211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:25.881226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:25.943042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2c3e-7954-4c37-9e32-eaf5658c73b3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:25.978485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:25.979275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:25.979792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:25.979792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:25.980301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:25.980757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:25.982131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:25.994931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 510/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:26.000531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:26.106324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e9eb1-296e-42c5-a678-f3d7baa0a783 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:26.140771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:26.141320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.141602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.141884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.149299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:26.150760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:26.161647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:26.162807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:48:26.163992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:26.167564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 528/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:48:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:26.168984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:26.273319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac4a6a-5139-44d4-b4df-6cd385447f56 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:26.275117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:26.308345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:26.308952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.309233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.309508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.310236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:26.310543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:26.311957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e9ddb-99ac-42e0-a5a9-e84fe33dc8eb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:26.330427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 511/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:48:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:26.336072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:26.378350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:26.437266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e1e25-3270-467a-9375-cfdfb29fed03 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:26.471196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:26.471804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.472084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.472381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.544456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:26.545887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:26.586530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:26.616945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb598-7d1e-42be-89fb-9392991288d4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.617380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb598-7d1e-42be-89fb-9392991288d4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.617670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb598-7d1e-42be-89fb-9392991288d4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.619671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 512/1040] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:26.625192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.625698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.625825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.644260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:26.645523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:26.653622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 529/1041] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:48:26.655500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:26.716595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 513/1042] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:26.768669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266887c0-6c93-46af-9019-fab366e00d34 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:26.802570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:26.803191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.803466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.803734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.811794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:26.814647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:26.816359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:26.830483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:26.832516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:26.833459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:26.833459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:26.833459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:26.833459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 530/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:26.837570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:26.932427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:26.941995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3752a-df08-452d-a505-3757130ffb21 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:26.976197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:26.976750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:26.977026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:26.977295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:26.977927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:26.978223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:26.980190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:26.989348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:26.996584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 514/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:26.998086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.096084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454d4e2-ae1c-41ff-8f29-7d0189b90689 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.099438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fa5dd-8ab6-41d2-a08e-f5193f4f4fcd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.128680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.129299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.129572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.129841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] PATH_INFO: `/v3/services/image` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.130412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.131747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.132083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.132738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.133019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.133299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.140430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c3352f0c-7c15-4720-bccf-9e584f490d06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:27.140705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:27.141840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 10:48:27.143091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:27.143862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.143932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 531/1045] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Sep 15 10:48:26 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:27.143932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c28eb-3cc6-41c8-93a1-db0c9c628823 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.143932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c28eb-3cc6-41c8-93a1-db0c9c628823 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.143932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c28eb-3cc6-41c8-93a1-db0c9c628823 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.145099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 532/1046] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:27.149507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c28eb-3cc6-41c8-93a1-db0c9c628823 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2c5796c9-5096-4d08-9c0b-48549a0fb543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:27.155786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:27.156772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 515/1047] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.162674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.163286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.176633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:27.177816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:27.180602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:27.207634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:27.249323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 516/1048] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:27.249929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.273286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c28eb-3cc6-41c8-93a1-db0c9c628823 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.308429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.309032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.309307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.309578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.310205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] RBAC: Adding query filter params (name=image) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:27.310501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.311835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.317141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 533/1049] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:27.323148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.368358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafe33d-284c-474b-8ddb-d4870662662a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.406015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.406620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.406896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.407166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.407844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:27.408143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.409584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.418722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:27.422266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 517/1050] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:27.428144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.432368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030e4c-04e1-4ef8-ac45-5b4817569efb None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.456150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:27.472200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.472847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.473470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.473745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.474521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:27.474821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.476202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.481221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 534/1051] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:27.486806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.535778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87518a-09db-4d29-a150-68a4da9b2af9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.569991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.570597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.570881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.571162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.571887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] RBAC: Adding query filter params (role.id=2644dc977bad4e8394d5192d9bbab039, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=3c2b03530d554c27b1dc3282a5063df4) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:27.572409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.573952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.579223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 518/1052] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/role_assignments?user.id=3c2b03530d554c27b1dc3282a5063df4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=2644dc977bad4e8394d5192d9bbab039 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:27.579994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.591554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf585-5cf5-4a30-b06c-2e1423dd59e1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.630902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.631531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.631812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.632086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.632810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.634212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.654978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:27.694401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28aab17-cf92-483d-aa21-979533aa01f6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.724348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 535/1053] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:48:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:48:27.748992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234efe-642d-4785-b109-686645649ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.749639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234efe-642d-4785-b109-686645649ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.749912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234efe-642d-4785-b109-686645649ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.750181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234efe-642d-4785-b109-686645649ce1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.764947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af234efe-642d-4785-b109-686645649ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-af234efe-642d-4785-b109-686645649ce1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:27.770710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:27.771739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:27.772678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 519/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:27.778080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:27.852804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:27.918410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803c82-893f-4a0a-ab46-3942c923fb2b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:27.955024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:27.955634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:27.955909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:27.956179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:27.956917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:27.957217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:27.958565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:27.968232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 536/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:27.973626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234efe-642d-4785-b109-686645649ce1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:28.082581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234efe-642d-4785-b109-686645649ce1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:28.104360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:28.119041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:28.119758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:28.119953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:28.120275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] PATH_INFO: `/v3/users/97dda5b3c9d4435f87a44a1c87392a86` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:28.134255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] RBAC: Authorizing `identity:get_user(user_id=97dda5b3c9d4435f87a44a1c87392a86)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:28.136334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:28.143008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 520/1056] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:27 2022] GET /identity/v3/users/97dda5b3c9d4435f87a44a1c87392a86 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:28.144236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:28.247367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1578f8-0eaf-457d-8d59-5e106f526c74 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:28.249067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:28.282576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:28.283176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:28.283451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:28.283719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:28.350346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:28.351773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:28.447606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 537/1057] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:48:28.453244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:28.557739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f5bcc-33c5-4395-86d8-6b39ff3cba50 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:28.591552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e7e15-777d-45fa-a596-248f7cf24cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:28.592185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7e15-777d-45fa-a596-248f7cf24cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:28.592491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7e15-777d-45fa-a596-248f7cf24cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:28.592767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e7e15-777d-45fa-a596-248f7cf24cf1 None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:28.593870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e7e15-777d-45fa-a596-248f7cf24cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=29770965e32d48bbbe5bf80052aa58fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:28.595287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e7e15-777d-45fa-a596-248f7cf24cf1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:28.597078 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 521/1058] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:28 2022] GET /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:28.603035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:28.607596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:28.705203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca9f7-6360-4767-b215-fd0e232d6609 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:28.747558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:28.748619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:28.749121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:28.749619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:28.751004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=29770965e32d48bbbe5bf80052aa58fd, user.id=97dda5b3c9d4435f87a44a1c87392a86) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:28.751556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:28.753979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc05a0-c574-4ffe-8155-904211b74c01 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:28.768423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 538/1059] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:28 2022] GET /identity/v3/role_assignments?user.id=97dda5b3c9d4435f87a44a1c87392a86&scope.project.id=29770965e32d48bbbe5bf80052aa58fd&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:29.748239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bb177-2652-400c-a4e7-d231a090bc5a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:29.748788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bb177-2652-400c-a4e7-d231a090bc5a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:29.748788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bb177-2652-400c-a4e7-d231a090bc5a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:29.750176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 522/1060] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:29.755351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaaede-8190-40a1-a073-dc68d4618bdb None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:29.755765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaaede-8190-40a1-a073-dc68d4618bdb None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:29.755909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaaede-8190-40a1-a073-dc68d4618bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:29.774747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6dcaaede-8190-40a1-a073-dc68d4618bdb None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:29.776219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6dcaaede-8190-40a1-a073-dc68d4618bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:29.837010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:29.846055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 539/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:29.966740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96cd7-2f87-4427-a747-66b2edab4138 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:29.967057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96cd7-2f87-4427-a747-66b2edab4138 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:29.967299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee96cd7-2f87-4427-a747-66b2edab4138 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:29.968822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 523/1062] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:29.974000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:29.974299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:29.975475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:29.997020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:29.998202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:30.068643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 540/1063] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:30.133589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96cd7-2f87-4427-a747-66b2edab4138 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.181504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.236274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee96cd7-2f87-4427-a747-66b2edab4138 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.276234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.276234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.276234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.276234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.287240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:30.292021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:30.292988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:30.293849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 524/1064] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:30.300589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.349922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.406242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc8360-6831-4ed7-a145-c1ef7b3936f1 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.434632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.444337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.445133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.447440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.447440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.447440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:30.447440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:30.448896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:30.454566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a431-503c-4815-8126-2e08dad7a704 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.457002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 541/1065] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:30.463031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.467382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.500013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.500653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.500934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.501208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.569663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49274dd-dde9-424b-a255-e4962a58fff3 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.572932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:30.574386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:30.609536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.610346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.610696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.611188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.622964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:30.624426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:30.638731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:30.639908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:30.641013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:30.641013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:30.641013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:30.641013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 542/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:30.645458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.689612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.693926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 525/1067] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 10:48:30.699620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.708031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.758768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02777a-76f2-418c-8b44-104a7b57fa4a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.797903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.798532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.798815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.799093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.799748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:30.800054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:30.801496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:30.814684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 543/1068] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:30.816732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590afa0d-2da2-4371-afec-f32e2c7ca330 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.820433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.857235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.858188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.858653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.859110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.870917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:30.872773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4545ed4a-756c-4847-8da0-7aa3fba97ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:30.889410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:30.890410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:30.891525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:30.891525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:30.891525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:30.893102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 526/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:30.896436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55918256-cfc1-4e15-b8cc-d5cc8bb18a6f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.896721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55918256-cfc1-4e15-b8cc-d5cc8bb18a6f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.896998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55918256-cfc1-4e15-b8cc-d5cc8bb18a6f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.898246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 527/1070] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:48:30.898919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55918256-cfc1-4e15-b8cc-d5cc8bb18a6f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:30.925278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.927983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1438-0b49-4649-b78b-3190b3fe3554 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:30.958971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:30.961540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:30.962160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.962439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.962769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:30.970096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:30.971531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-f67e6f9d-7ed7-4ebf-ad6d-45f8de98ee25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:30.983758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:30.989760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 544/1071] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:30.991254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:30.992136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.002914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55918256-cfc1-4e15-b8cc-d5cc8bb18a6f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.007371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:31.008573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:31.035719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.036347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.036646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.036915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.037555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:31.037878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.039242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.051741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 528/1072] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:31.052586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.091140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 545/1073] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:31.165089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae65a2-a507-45e8-9482-8d1a221c8eea None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.184529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:31.203856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.204512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.204794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.205069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.205828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:31.206116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.207558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.227316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 529/1074] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:31.233140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.328632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:31.338389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e511a-c4b3-441a-a591-31b331b39e1c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.362680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.374399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.375042 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.375317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.375590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.387477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.388942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:31.404158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:31.405272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:31.406186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:31.406186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:31.406186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:31.406186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 546/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:31.411229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.464623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ba951-439f-40a0-bc85-cb8ab4d7174e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.499253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.499875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.500156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.500470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.510231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f863e9-4a4e-40f5-ab4e-f6db5405178f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.510952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:31.515732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:31.516894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:31.517798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 530/1076] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:31.522864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.545067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.545672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.545954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.546229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.546866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:31.547171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.548543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.558310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:31.561382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 547/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:31.566950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.569567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:31.623083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba00c-c9dd-44f3-a1d8-5ebf14022343 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.657257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.657876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.658158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.658436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.659110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:31.659417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.660825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.669367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 531/1078] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:31.673421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346dc5f-7bd6-4ece-a71f-84ef3387f90d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.677445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.716530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.717323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.717618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.717890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.727165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.729463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:31.748515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:31.749688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:31.756853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 548/1079] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:31.759008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.812860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:31.816667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13790-c65b-4ea2-ad5f-a79533dce580 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.835973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:31.850789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.851413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.851694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.851975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] PATH_INFO: `/v3/users/97dda5b3c9d4435f87a44a1c87392a86` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.853259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] RBAC: Authorizing `identity:get_user(user_id=97dda5b3c9d4435f87a44a1c87392a86)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.854791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.856639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 532/1080] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/users/97dda5b3c9d4435f87a44a1c87392a86 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:31.862265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.876260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6db80b-c89b-4183-b48a-6d65be40a9a8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.911908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.912535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.912815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.913088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:31.913978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:31.914089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:31.915458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:31.928447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 549/1081] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:31.934937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:31.964197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566266c-f50b-4115-bb88-38259c6ecd49 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:31.998316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:31.998940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:31.999231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:31.999509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:32.000659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] RBAC: Authorizing `identity:get_project(project_id=29770965e32d48bbbe5bf80052aa58fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:32.002091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:32.003744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 533/1082] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:31 2022] GET /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:32.009592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:32.033571 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9b4f6-b6c1-4e8f-83e6-c0b4727a99f8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:32.048679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:32.057146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:32.069180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c4dd-de1f-4e41-8e7d-84d547d8e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:32.070047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c4dd-de1f-4e41-8e7d-84d547d8e406 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:32.070413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c4dd-de1f-4e41-8e7d-84d547d8e406 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:32.070817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c4dd-de1f-4e41-8e7d-84d547d8e406 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/3c2b03530d554c27b1dc3282a5063df4/roles/2644dc977bad4e8394d5192d9bbab039` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:32.073213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c4dd-de1f-4e41-8e7d-84d547d8e406 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=3c2b03530d554c27b1dc3282a5063df4, role_id=2644dc977bad4e8394d5192d9bbab039)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:32.074690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c4dd-de1f-4e41-8e7d-84d547d8e406 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:32.113359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232759-81a5-4449-a9a2-b8ed365908a1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:32.132045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 550/1083] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:48:31 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/3c2b03530d554c27b1dc3282a5063df4/roles/2644dc977bad4e8394d5192d9bbab039 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:48:32.150468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09253a0a-31c4-4e5e-af74-c4b5faed44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:32.151539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09253a0a-31c4-4e5e-af74-c4b5faed44f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:32.151884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09253a0a-31c4-4e5e-af74-c4b5faed44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:32.152168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09253a0a-31c4-4e5e-af74-c4b5faed44f0 None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd/users/97dda5b3c9d4435f87a44a1c87392a86/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:32.154290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09253a0a-31c4-4e5e-af74-c4b5faed44f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=29770965e32d48bbbe5bf80052aa58fd, user_id=97dda5b3c9d4435f87a44a1c87392a86, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:32.155761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09253a0a-31c4-4e5e-af74-c4b5faed44f0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:32.213285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 534/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:48:32 2022] PUT /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd/users/97dda5b3c9d4435f87a44a1c87392a86/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:48:34.281923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fdeb1-6984-4980-bb8e-836ca0cbd645 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.282454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fdeb1-6984-4980-bb8e-836ca0cbd645 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.282454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fdeb1-6984-4980-bb8e-836ca0cbd645 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.283959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 551/1085] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:34.290107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061560a-97df-4337-99c6-39fa75431888 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.291426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061560a-97df-4337-99c6-39fa75431888 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.291426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061560a-97df-4337-99c6-39fa75431888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.314279 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2061560a-97df-4337-99c6-39fa75431888 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:34.315451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2061560a-97df-4337-99c6-39fa75431888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:34.381382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 535/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:34.385569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c258-76fe-44fb-8d8a-0151bb5aef4e None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.385883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c258-76fe-44fb-8d8a-0151bb5aef4e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.386159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311c258-76fe-44fb-8d8a-0151bb5aef4e None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.387490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 552/1087] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:34.392659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.392949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.393225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.411301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:34.412491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:34.430043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:34.477128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 536/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:34.652681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c258-76fe-44fb-8d8a-0151bb5aef4e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:34.744797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:34.752069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311c258-76fe-44fb-8d8a-0151bb5aef4e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:34.792252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:34.793331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.793692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.794095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.805508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:34.810948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:34.812211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:34.813160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 553/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Sep 15 10:48:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:34.818141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:34.852039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5cac2-9c70-4816-9a35-29b808d484e7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:34.862422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:34.885971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:34.886599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.886872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.887142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.897251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:34.902624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:34.903797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:34.904971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 537/1090] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:34.909620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:34.922293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6693-2a2d-4f3c-a7fd-ed460b762625 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:34.925862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:34.956629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:34.957247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:34.957530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:34.957802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:34.958458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:34.958760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:34.960107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:34.968617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 554/1091] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:48:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:34.974493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.011071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68bcbc-91c7-4609-8288-1a652b289374 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.047156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.047769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.048049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.048333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.049012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:35.049315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.050710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.059570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 538/1092] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:35.065378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.072424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c27ea-66d9-4f21-8853-4ec6c72a5c62 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.075516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.107589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.108530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.108738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.109208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.120674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.122104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:35.136210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:35.137286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:35.138208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:35.138208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:35.138208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:35.138208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 555/1093] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:35.141849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.143144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.164413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c051f4-867f-4e52-9c25-e164ae920993 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.198829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.199453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.199734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.200004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] PATH_INFO: `/v3/users/97dda5b3c9d4435f87a44a1c87392a86` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.201154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] RBAC: Authorizing `identity:get_user(user_id=97dda5b3c9d4435f87a44a1c87392a86)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.202578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.204140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 539/1094] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/users/97dda5b3c9d4435f87a44a1c87392a86 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:35.209989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.243235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98676d5-d7e6-4e21-94fa-ca344b97b3e7 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.275887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.276511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.276787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.277056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.277688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:35.278083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.279423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.291175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 556/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:35.296800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.309616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903fc83-f789-45db-aa77-8ed9691ca266 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.314285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.341836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.342441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.342716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.342986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.357400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.394448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34733f-089b-45c9-87f5-a72d3a430586 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.409789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.411314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.428274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.428870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.429150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.429428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.436249 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.437691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:48:35.449389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:35.453702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:35.454736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 557/1096] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:35.456301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.514404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 540/1097] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 10:48:35.520283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.531783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.554232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce52ff4-ca74-44e9-94f2-45085d44e165 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.566028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.592071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.592779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.593353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.593629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.594353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:35.594654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.596068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.614842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 558/1098] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:35.621427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.623651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f4c52-0fc6-4487-b05d-ca4adfbe4ab6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.659227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.659852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.660130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.660434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.661543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] RBAC: Authorizing `identity:get_project(project_id=29770965e32d48bbbe5bf80052aa58fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.662964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.664743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 541/1099] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:35.671398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:35.721683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316906b7-9b9d-47ef-8f3b-e2b2c123aa3c None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.755401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.755997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.756275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.756581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.759153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.769201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76ddad-f489-4707-8465-9d00697979d0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:35.782639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:35.803333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:35.803935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:35.804214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:35.804571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:35.805296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=29770965e32d48bbbe5bf80052aa58fd, user.id=97dda5b3c9d4435f87a44a1c87392a86) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:35.805604 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.807613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.813299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 542/1100] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/role_assignments?user.id=97dda5b3c9d4435f87a44a1c87392a86&scope.project.id=29770965e32d48bbbe5bf80052aa58fd&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:35.824723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:35.826329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:35.934933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 559/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 10:48:35.941139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:36.055450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3736d6-6292-4ae9-9f8d-dd9926e625d8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:36.090090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:36.090722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:36.091005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:36.091281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:36.102779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:36.104860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:48:36.119788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:36.120860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:48:36.121749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:48:36.121749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:48:36.121749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:36.124453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 543/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:48:36.126587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:36.158691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:36.223812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6dcf3-3b3d-4723-a804-2c7f47815d18 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:36.257488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:36.258084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:36.258359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:36.258632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:36.259390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:36.259933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:36.264377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:36.274526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 560/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:36.280933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:36.310464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:36.381076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ae330-f5ae-4614-9b2f-88f2a4f85f9d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:36.413706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:36.414323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:36.414602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:36.414875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:36.421454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:36.422905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:48:36.434305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:36.435356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:48:36.436504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:48:36.440210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 544/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:36.441180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:36.531219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:36.537721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3800f-9d13-4878-b7c6-557a834d57e8 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:36.571175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:36.572358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:36.572857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:36.572857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:36.573474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:36.573773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:36.575169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104c14-bce8-4db1-af1b-ef3bb8e1b98e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:36.587000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 561/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:36.593226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:36.681666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:36.693606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae3987-8ab2-4349-8355-db7fe43e254e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:36.727921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:36.729827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:36.730111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:36.730392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:36.731161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] RBAC: Adding query filter params (role.id=2644dc977bad4e8394d5192d9bbab039, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=3c2b03530d554c27b1dc3282a5063df4) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:36.731476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:36.733003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592db34-b0c9-420a-89d1-eb661682dae6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:36.739614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 545/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:36 2022] GET /identity/v3/role_assignments?user.id=3c2b03530d554c27b1dc3282a5063df4&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=2644dc977bad4e8394d5192d9bbab039 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:48:38.000716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795bf08-7903-4593-bef0-2766a9dea145 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:38.001363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795bf08-7903-4593-bef0-2766a9dea145 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:38.001363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795bf08-7903-4593-bef0-2766a9dea145 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:38.002598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 562/1107] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:38.007759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:38.008206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:38.008329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:38.026851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:38.028037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:38.092124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 546/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:38.360204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795bf08-7903-4593-bef0-2766a9dea145 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:38.457371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795bf08-7903-4593-bef0-2766a9dea145 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:38.489046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d7b8-638d-415c-8c7c-f27a0a454371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:38.489641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d7b8-638d-415c-8c7c-f27a0a454371 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:38.489915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d7b8-638d-415c-8c7c-f27a0a454371 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:38.490181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d7b8-638d-415c-8c7c-f27a0a454371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:38.491516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d7b8-638d-415c-8c7c-f27a0a454371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:38.492946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d7b8-638d-415c-8c7c-f27a0a454371 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:38.495192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 563/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:38.500825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:38.577784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:38.595637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3f80-e0d4-4044-a9b0-52483c756b53 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:38.629051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847ae36-ebd6-40ce-ada5-38e1633a075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:38.629591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ae36-ebd6-40ce-ada5-38e1633a075f None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:38.629867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ae36-ebd6-40ce-ada5-38e1633a075f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:38.630138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847ae36-ebd6-40ce-ada5-38e1633a075f None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:38.630780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ae36-ebd6-40ce-ada5-38e1633a075f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:38.632184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847ae36-ebd6-40ce-ada5-38e1633a075f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:38.729623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 547/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:48:38 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 10:48:40.954363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff280d9d-e0fa-406c-bc78-8ca0f81717c0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:40.954924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff280d9d-e0fa-406c-bc78-8ca0f81717c0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:40.954924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff280d9d-e0fa-406c-bc78-8ca0f81717c0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:40.956228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 564/1111] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:40.961376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:40.961797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:40.961937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:40.979792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:40.981002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:41.051594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 548/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:41.317283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff280d9d-e0fa-406c-bc78-8ca0f81717c0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:41.342385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:41.420759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff280d9d-e0fa-406c-bc78-8ca0f81717c0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:41.453471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:41.454088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:41.454366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:41.454639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] PATH_INFO: `/v3/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:41.456002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] RBAC: Authorizing `identity:get_role(role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:41.457380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:41.458676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 565/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:41 2022] GET /identity/v3/roles/9efddb790ba641d59d0f165b116e2876 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:41.465140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:41.529097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:41.560191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2bcd2-6e21-4895-a85c-7e932ad71d91 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:41.593503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:41.594297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:41.594819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:41.595566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] PATH_INFO: `/v3/users/744f1bea1e834ff3ade925eca76dacf6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:41.608584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] RBAC: Authorizing `identity:get_user(user_id=744f1bea1e834ff3ade925eca76dacf6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:41.610021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:41.611598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 549/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:41 2022] GET /identity/v3/users/744f1bea1e834ff3ade925eca76dacf6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:41.617588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:41.706163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:41.715601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ff73-363b-48fb-beaf-b39fe647ebf2 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:41.749121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:41.749715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:41.749989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:41.750258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:41.814517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:41.815942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:41.900125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:41.909598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 566/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:48:41.915611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:42.029448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f089d3-f521-41c9-94e9-bb8295b9342a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:42.057804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:42.067179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2205-4a18-499c-a0f3-01ae90c5a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:42.068523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2205-4a18-499c-a0f3-01ae90c5a526 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:42.068813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2205-4a18-499c-a0f3-01ae90c5a526 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:42.069091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2205-4a18-499c-a0f3-01ae90c5a526 None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:42.070871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2205-4a18-499c-a0f3-01ae90c5a526 None admin] RBAC: Authorizing `identity:get_project(project_id=29770965e32d48bbbe5bf80052aa58fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:42.072586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2205-4a18-499c-a0f3-01ae90c5a526 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:42.074453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 550/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:41 2022] GET /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:42.080898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:42.179415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf51a66-6d99-4784-9b73-ca584ef6ed00 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:42.215758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:42.216383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:42.216664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:42.216933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:42.217650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] RBAC: Adding query filter params (role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=29770965e32d48bbbe5bf80052aa58fd, user.id=744f1bea1e834ff3ade925eca76dacf6) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:42.217954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:42.219377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b543a2-ce62-41d4-8a77-d85f72d36ac9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:42.226452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 567/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:42 2022] GET /identity/v3/role_assignments?user.id=744f1bea1e834ff3ade925eca76dacf6&scope.project.id=29770965e32d48bbbe5bf80052aa58fd&role.id=9efddb790ba641d59d0f165b116e2876 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:44.428801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e222e-4380-48a8-8a45-219c39d77079 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:44.429347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e222e-4380-48a8-8a45-219c39d77079 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:44.429347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e222e-4380-48a8-8a45-219c39d77079 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:44.430710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 551/1118] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:44.435787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:44.436214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:44.436338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:44.454510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:44.455691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:44.503323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:44.520373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 568/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:44.791876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e222e-4380-48a8-8a45-219c39d77079 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:44.900568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e222e-4380-48a8-8a45-219c39d77079 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:44.933775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:44.934395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:44.934670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:44.934938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] PATH_INFO: `/v3/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:44.936284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] RBAC: Authorizing `identity:get_role(role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:44.937672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:44.938970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 552/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:44 2022] GET /identity/v3/roles/9efddb790ba641d59d0f165b116e2876 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:44.945109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:45.041203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420853b-9551-4b7f-9280-98fcb1edd7e0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:45.074160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:45.074724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:45.075005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:45.075281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] PATH_INFO: `/v3/users/744f1bea1e834ff3ade925eca76dacf6` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:45.076415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] RBAC: Authorizing `identity:get_user(user_id=744f1bea1e834ff3ade925eca76dacf6)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:45.077827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:45.079396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 569/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:44 2022] GET /identity/v3/users/744f1bea1e834ff3ade925eca76dacf6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:45.085170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:45.145164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:45.181744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cab18c-2fb3-4e6d-a5fb-e65ba207456c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:45.215431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066fa88-b5c8-4994-a58b-fa4a5041155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:45.216047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066fa88-b5c8-4994-a58b-fa4a5041155b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:45.216346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066fa88-b5c8-4994-a58b-fa4a5041155b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:45.216634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066fa88-b5c8-4994-a58b-fa4a5041155b None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:45.217737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066fa88-b5c8-4994-a58b-fa4a5041155b None admin] RBAC: Authorizing `identity:get_project(project_id=29770965e32d48bbbe5bf80052aa58fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:45.219161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066fa88-b5c8-4994-a58b-fa4a5041155b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:45.220793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 553/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:45 2022] GET /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:45.226870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:45.278117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:45.323786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24555d5-bb6b-4ea2-809e-a278be9beff1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:45.356739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cbd4b-ca57-4042-83a5-2373781a5acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:45.357384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cbd4b-ca57-4042-83a5-2373781a5acb None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:45.357941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cbd4b-ca57-4042-83a5-2373781a5acb None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:45.358215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cbd4b-ca57-4042-83a5-2373781a5acb None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd/users/744f1bea1e834ff3ade925eca76dacf6/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:45.360340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cbd4b-ca57-4042-83a5-2373781a5acb None admin] RBAC: Authorizing `identity:create_grant(project_id=29770965e32d48bbbe5bf80052aa58fd, user_id=744f1bea1e834ff3ade925eca76dacf6, role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:45.361751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cbd4b-ca57-4042-83a5-2373781a5acb None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:45.431932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 570/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:48:45 2022] PUT /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd/users/744f1bea1e834ff3ade925eca76dacf6/roles/9efddb790ba641d59d0f165b116e2876 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:48:47.549071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac7970-1757-41b1-ad72-1e1c2990152e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:47.549599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac7970-1757-41b1-ad72-1e1c2990152e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:47.549706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac7970-1757-41b1-ad72-1e1c2990152e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:47.550956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 554/1124] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:47.556163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:47.556629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:47.557312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:47.575549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:47.576750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:47.642706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 571/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:47.911775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac7970-1757-41b1-ad72-1e1c2990152e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:48.012699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac7970-1757-41b1-ad72-1e1c2990152e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:48.041724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:48.047307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:48.047936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:48.048213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:48.048512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] PATH_INFO: `/v3/roles/9efddb790ba641d59d0f165b116e2876` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:48.049868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] RBAC: Authorizing `identity:get_role(role_id=9efddb790ba641d59d0f165b116e2876)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:48.051213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:48.052553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 555/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:47 2022] GET /identity/v3/roles/9efddb790ba641d59d0f165b116e2876 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:48.058472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:48.100350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:48.154247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37b27d-8387-4b69-aed4-dd3eac0c8a6e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:48.186789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:48.187341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:48.187614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:48.187882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] PATH_INFO: `/v3/users/744f1bea1e834ff3ade925eca76dacf6` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:48.188987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] RBAC: Authorizing `identity:get_user(user_id=744f1bea1e834ff3ade925eca76dacf6)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:48.190375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:48.191907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 572/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:48 2022] GET /identity/v3/users/744f1bea1e834ff3ade925eca76dacf6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:48.197634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:48.294595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e24bf-c9b4-44eb-9376-65dd3fc4670f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:48.328233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:48.328923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:48.329204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:48.329481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:48.391397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:48.394766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:48.396205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:48.490998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 556/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:48:48.497008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:48.591872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9592f-da2e-42e3-9bdc-b351cf769702 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:48.601968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:48.624516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84392d70-06d3-4520-b0b3-c1374fd51867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:48.625171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392d70-06d3-4520-b0b3-c1374fd51867 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:48.625633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392d70-06d3-4520-b0b3-c1374fd51867 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:48.626067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392d70-06d3-4520-b0b3-c1374fd51867 None admin] PATH_INFO: `/v3/projects/29770965e32d48bbbe5bf80052aa58fd` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:48.627432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392d70-06d3-4520-b0b3-c1374fd51867 None admin] RBAC: Authorizing `identity:get_project(project_id=29770965e32d48bbbe5bf80052aa58fd)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:48.628878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392d70-06d3-4520-b0b3-c1374fd51867 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:48.630467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 573/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:48 2022] GET /identity/v3/projects/29770965e32d48bbbe5bf80052aa58fd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:48.636534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:48.727157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:48.731330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd7617-247c-48f2-85e5-d54de1b7c78f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:48.765291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:48.765821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:48.766097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:48.766369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:48.767083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] RBAC: Adding query filter params (role.id=9efddb790ba641d59d0f165b116e2876, scope.project.id=29770965e32d48bbbe5bf80052aa58fd, user.id=744f1bea1e834ff3ade925eca76dacf6) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:48.767384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:48.768840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9ad40-28e0-4330-b6b6-1cdf63f85795 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:48.775236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 557/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:48 2022] GET /identity/v3/role_assignments?user.id=744f1bea1e834ff3ade925eca76dacf6&scope.project.id=29770965e32d48bbbe5bf80052aa58fd&role.id=9efddb790ba641d59d0f165b116e2876 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:50.938451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11460-cef0-4d25-92e7-a67d5534784d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:50.939028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11460-cef0-4d25-92e7-a67d5534784d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:50.939028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11460-cef0-4d25-92e7-a67d5534784d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:50.940340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 574/1131] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:50.945991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:50.946471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:50.947177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:50.965032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:50.966213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:51.031150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 558/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:48:51.303284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11460-cef0-4d25-92e7-a67d5534784d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:51.402120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11460-cef0-4d25-92e7-a67d5534784d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:51.443429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70654f86-ff8b-4240-9a0f-6c44975ee6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:51.444051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654f86-ff8b-4240-9a0f-6c44975ee6fd None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:51.444352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654f86-ff8b-4240-9a0f-6c44975ee6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:51.444632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654f86-ff8b-4240-9a0f-6c44975ee6fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:51.445730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70654f86-ff8b-4240-9a0f-6c44975ee6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:51.447588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70654f86-ff8b-4240-9a0f-6c44975ee6fd None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:51.449176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 575/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:51.455075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:51.542452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:51.550506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3caeb-269a-4ec2-93e7-565e222d731e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:51.582937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb809-3256-4050-a483-3d60f60dd73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:51.583796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb809-3256-4050-a483-3d60f60dd73f None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:51.584076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb809-3256-4050-a483-3d60f60dd73f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:51.584374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb809-3256-4050-a483-3d60f60dd73f None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:51.585008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb809-3256-4050-a483-3d60f60dd73f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:51.586422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb809-3256-4050-a483-3d60f60dd73f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:51.691883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 559/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:48:51 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:53.904101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17780-0956-4145-9e0b-9a4f789c4d3a None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:53.904696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17780-0956-4145-9e0b-9a4f789c4d3a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:53.904696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17780-0956-4145-9e0b-9a4f789c4d3a None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:53.906007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 576/1135] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:53.911163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:53.911597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:53.911778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:53.929586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:53.931272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:53.997065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 560/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:54.265641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac17780-0956-4145-9e0b-9a4f789c4d3a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:54.317591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:54.368844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac17780-0956-4145-9e0b-9a4f789c4d3a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:54.400879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16037e6-df72-4d5b-b0ae-e3bca254db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:54.401486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16037e6-df72-4d5b-b0ae-e3bca254db08 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:54.401762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16037e6-df72-4d5b-b0ae-e3bca254db08 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:54.402033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16037e6-df72-4d5b-b0ae-e3bca254db08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:54.403115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16037e6-df72-4d5b-b0ae-e3bca254db08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:54.404536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16037e6-df72-4d5b-b0ae-e3bca254db08 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:54.406058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 577/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:54.411734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:54.483568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:54.506907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfedb2-a884-4a5b-868b-ad64e1cf3e0c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:54.539271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae154-cf68-4cd7-8c74-d229dc69442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:54.540464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae154-cf68-4cd7-8c74-d229dc69442a None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:54.540747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae154-cf68-4cd7-8c74-d229dc69442a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:54.541017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae154-cf68-4cd7-8c74-d229dc69442a None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:54.541655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae154-cf68-4cd7-8c74-d229dc69442a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:54.543066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae154-cf68-4cd7-8c74-d229dc69442a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:54.616131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 561/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:48:54 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:48:56.827934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279370-70d2-4b44-ae4e-5e5c255d2320 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:56.828532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279370-70d2-4b44-ae4e-5e5c255d2320 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:56.828650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41279370-70d2-4b44-ae4e-5e5c255d2320 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:56.829982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 578/1139] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:48:56.835128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:56.835539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:56.835678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:56.853418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:48:56.854579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:48:56.918722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 562/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:48:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:48:57.195164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41279370-70d2-4b44-ae4e-5e5c255d2320 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:57.293755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41279370-70d2-4b44-ae4e-5e5c255d2320 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:57.307671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:57.326724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:57.327342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:57.327621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:57.327895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:57.338035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:48:57.343210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:48:57.344414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:48:57.345341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 579/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:48:57.350290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:57.408475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:57.449686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356839a-c210-48d7-b883-9574e2ef9c60 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:57.484005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:57.484632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:57.484914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:57.485190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:57.485851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:57.486155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:57.487509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:57.495989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 563/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:57.501959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:57.598895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552f518-4b71-43c2-b3cf-d762575ef9d1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:57.632063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:57.632699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:57.632977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:57.633394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] PATH_INFO: `/v3/users/93983685a58e477f910a5f084df35c53` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:57.645884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] RBAC: Authorizing `identity:get_user(user_id=93983685a58e477f910a5f084df35c53)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:57.647294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:57.649430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 580/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:48:57 2022] GET /identity/v3/users/93983685a58e477f910a5f084df35c53 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:57.655138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:57.752137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0cf96-24c5-4978-9b19-743b7740ac93 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:57.774422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:57.785662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:57.790971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:57.790971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:57.790971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:57.851629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:57.853199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:57.948533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 564/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:48:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:48:57.954604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:57.984874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:58.051440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4dc75-7652-4462-8167-c72744c2445b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:58.085364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dac88-7801-4d0c-b9db-3044020e08e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:58.085982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dac88-7801-4d0c-b9db-3044020e08e8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:58.086900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dac88-7801-4d0c-b9db-3044020e08e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:58.087239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dac88-7801-4d0c-b9db-3044020e08e8 None admin] PATH_INFO: `/v3/projects/e4a20f19997542e6b3d56fd1c276a552` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:58.088421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dac88-7801-4d0c-b9db-3044020e08e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a20f19997542e6b3d56fd1c276a552)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:58.089838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dac88-7801-4d0c-b9db-3044020e08e8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:58.091459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 581/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:48:57 2022] GET /identity/v3/projects/e4a20f19997542e6b3d56fd1c276a552 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:48:58.097782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:48:58.121570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:48:58.193775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d8285-15eb-4c5f-b8c5-98d4c9a6e9ac None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:48:58.227602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:48:58.228197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:48:58.228510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:48:58.228785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:48:58.229502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=e4a20f19997542e6b3d56fd1c276a552, user.id=93983685a58e477f910a5f084df35c53) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:48:58.229807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:48:58.231224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426185c-a957-46d3-8e08-57196b490ca6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:48:58.236410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 565/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:48:58 2022] GET /identity/v3/role_assignments?user.id=93983685a58e477f910a5f084df35c53&scope.project.id=e4a20f19997542e6b3d56fd1c276a552&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:00.418423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8012f9-acd3-40f0-85cf-8fec28257784 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:00.418964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8012f9-acd3-40f0-85cf-8fec28257784 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:00.418964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8012f9-acd3-40f0-85cf-8fec28257784 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:00.420326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 582/1147] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:00.425538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:00.425945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:00.426083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:00.443806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:00.444993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:00.508402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 566/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:00.772099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8012f9-acd3-40f0-85cf-8fec28257784 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:00.865122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:00.868996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8012f9-acd3-40f0-85cf-8fec28257784 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:00.901604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:00.902211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:00.902486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:00.902756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:00.912710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:49:00.917482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:49:00.918609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:49:00.919655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 583/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:49:00.924635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:00.941605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:01.035323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf470b7f-6806-4442-a504-9e07477ffd24 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:01.067896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:01.068535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:01.068811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:01.069079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:01.069727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:01.070024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:01.072018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:01.079836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 567/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:01.086023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:01.185411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1d859-5843-4dcc-a1f2-87057ab97601 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:01.217482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:01.218094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:01.218367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:01.218636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] PATH_INFO: `/v3/users/93983685a58e477f910a5f084df35c53` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:01.219724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] RBAC: Authorizing `identity:get_user(user_id=93983685a58e477f910a5f084df35c53)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:01.221151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:01.222689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 584/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:49:01 2022] GET /identity/v3/users/93983685a58e477f910a5f084df35c53 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:01.228625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:01.305617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:01.327014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91410-ca1b-43d3-aa59-808f8d71ee36 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:01.358795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145c6b3-2f51-4b1d-9791-b6293a33d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:01.359400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145c6b3-2f51-4b1d-9791-b6293a33d915 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:01.359673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145c6b3-2f51-4b1d-9791-b6293a33d915 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:01.359943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145c6b3-2f51-4b1d-9791-b6293a33d915 None admin] PATH_INFO: `/v3/projects/e4a20f19997542e6b3d56fd1c276a552` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:01.361056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145c6b3-2f51-4b1d-9791-b6293a33d915 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a20f19997542e6b3d56fd1c276a552)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:01.362466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145c6b3-2f51-4b1d-9791-b6293a33d915 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:01.364044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 568/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:49:01 2022] GET /identity/v3/projects/e4a20f19997542e6b3d56fd1c276a552 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:01.370896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:01.401794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:01.471778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909891ae-9d87-4c1e-bb00-48afd0afdaea None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:01.504047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccc017-a762-4ebd-ae83-330f24017d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:01.504713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc017-a762-4ebd-ae83-330f24017d11 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:01.504989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc017-a762-4ebd-ae83-330f24017d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:01.505261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccc017-a762-4ebd-ae83-330f24017d11 None admin] PATH_INFO: `/v3/projects/e4a20f19997542e6b3d56fd1c276a552/users/93983685a58e477f910a5f084df35c53/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:01.507103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccc017-a762-4ebd-ae83-330f24017d11 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4a20f19997542e6b3d56fd1c276a552, user_id=93983685a58e477f910a5f084df35c53, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:01.508583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccc017-a762-4ebd-ae83-330f24017d11 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:01.588212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 585/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:49:01 2022] PUT /identity/v3/projects/e4a20f19997542e6b3d56fd1c276a552/users/93983685a58e477f910a5f084df35c53/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:49:03.747378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe17e-aa4d-4e68-a9d2-fa9f0ea7137b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:03.747916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe17e-aa4d-4e68-a9d2-fa9f0ea7137b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:03.747916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe17e-aa4d-4e68-a9d2-fa9f0ea7137b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:03.749291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 569/1154] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:03.754537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:03.754912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:03.755086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:03.772920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:03.774290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:03.838911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 586/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:04.113898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe17e-aa4d-4e68-a9d2-fa9f0ea7137b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:04.212636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe17e-aa4d-4e68-a9d2-fa9f0ea7137b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:04.245385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:04.246001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:04.246277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:04.246549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:04.256632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:49:04.261523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:49:04.262642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:49:04.263542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 570/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:49:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:49:04.268594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:04.286711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:04.363407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2baf-8efe-4d12-8e70-94b09600fbe8 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:04.395250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:04.395835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:04.396109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:04.396405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:04.397049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:04.397344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:04.399233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:04.406782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 587/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:49:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:04.412653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:04.422252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:04.510370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0336-ff43-4941-a42b-8a101b0f39c9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:04.542220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:04.542773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:04.543048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:04.543320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] PATH_INFO: `/v3/users/93983685a58e477f910a5f084df35c53` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:04.544441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] RBAC: Authorizing `identity:get_user(user_id=93983685a58e477f910a5f084df35c53)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:04.545857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:04.547389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 571/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:49:04 2022] GET /identity/v3/users/93983685a58e477f910a5f084df35c53 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:04.553067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:04.629815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:04.647566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ef6c0-771e-4129-91ad-b768ac1b54ea None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:04.679442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:04.680071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:04.680364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:04.680637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:04.746220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:04.747631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:04.823315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:04.842175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 588/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:49:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:49:04.848220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:04.922811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:04.947903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13bf24-c40f-413b-98a6-fc5208f14e3d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:04.980410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828dd70-8895-4efb-a1ff-ca78601d2c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:04.981033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828dd70-8895-4efb-a1ff-ca78601d2c07 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:04.981314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828dd70-8895-4efb-a1ff-ca78601d2c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:04.981589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828dd70-8895-4efb-a1ff-ca78601d2c07 None admin] PATH_INFO: `/v3/projects/e4a20f19997542e6b3d56fd1c276a552` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:04.982689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828dd70-8895-4efb-a1ff-ca78601d2c07 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a20f19997542e6b3d56fd1c276a552)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:04.984116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828dd70-8895-4efb-a1ff-ca78601d2c07 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:04.985738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 572/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:49:04 2022] GET /identity/v3/projects/e4a20f19997542e6b3d56fd1c276a552 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:04.992700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:05.099165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3706287-0c30-4ba3-9d24-c4a2ad64f728 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:05.136535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:05.137148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:05.137422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:05.137691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:05.138412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=e4a20f19997542e6b3d56fd1c276a552, user.id=93983685a58e477f910a5f084df35c53) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:05.138718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:05.140120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20e90-a6a4-447a-8bad-a0b518334832 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:05.146212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 589/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:49:04 2022] GET /identity/v3/role_assignments?user.id=93983685a58e477f910a5f084df35c53&scope.project.id=e4a20f19997542e6b3d56fd1c276a552&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:07.351378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ab2dd-10d8-47c6-97bf-99863fce020c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:07.352007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ab2dd-10d8-47c6-97bf-99863fce020c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:07.352737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ab2dd-10d8-47c6-97bf-99863fce020c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:07.354157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 573/1162] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:07.359350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:07.359738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:07.359901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:07.378295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:07.379475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:07.419277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:07.444819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 590/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:07.712566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ab2dd-10d8-47c6-97bf-99863fce020c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:07.810942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ab2dd-10d8-47c6-97bf-99863fce020c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:07.844948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:07.845546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:07.845824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:07.846098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:07.857570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:07.911760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:07.913234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:08.010501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 574/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:49:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:49:08.017218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:08.126515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5b3ba-10ee-44f7-8221-4c02ec51b477 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:08.159896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:08.160538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:08.160818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:08.161089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:08.168398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:08.169778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-04b03951-5f15-40b7-8773-23abd8650e6c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:49:08.181860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:49:08.182966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:49:08.183940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 591/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:49:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:49:08.189283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:08.233666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:08.290584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076315-40d6-4e75-8b67-b92b15227d88 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:08.324281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:08.324876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:08.325178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:08.325437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:08.326074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:08.326380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:08.327736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62527efd-cfbf-43f0-816c-b5dbcf7069c5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:08.334807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 575/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Sep 15 10:49:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:10.489980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b48f74-0dc6-4a3c-bca7-39c02dd7e871 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:10.490781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b48f74-0dc6-4a3c-bca7-39c02dd7e871 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:10.490781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b48f74-0dc6-4a3c-bca7-39c02dd7e871 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:10.492907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 592/1167] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:10.498156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd60fc-a749-4eda-8aed-0960f6695095 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:10.498620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd60fc-a749-4eda-8aed-0960f6695095 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:10.498720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd60fc-a749-4eda-8aed-0960f6695095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:10.516595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1dcd60fc-a749-4eda-8aed-0960f6695095 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:10.517764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1dcd60fc-a749-4eda-8aed-0960f6695095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:10.582808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 576/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:10.849397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b48f74-0dc6-4a3c-bca7-39c02dd7e871 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:10.884947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:10.948448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b48f74-0dc6-4a3c-bca7-39c02dd7e871 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:10.981569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998175f-c6ba-4af6-adc8-fdc4ca46852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:10.982162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998175f-c6ba-4af6-adc8-fdc4ca46852e None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:10.982441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998175f-c6ba-4af6-adc8-fdc4ca46852e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:10.982716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998175f-c6ba-4af6-adc8-fdc4ca46852e None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:10.983383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998175f-c6ba-4af6-adc8-fdc4ca46852e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:10.984762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998175f-c6ba-4af6-adc8-fdc4ca46852e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:11.052428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 593/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu Sep 15 10:49:10 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:49:13.219484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1085ad-00ee-45dc-a8d4-a5e6ae217411 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:13.220029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1085ad-00ee-45dc-a8d4-a5e6ae217411 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:13.220029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1085ad-00ee-45dc-a8d4-a5e6ae217411 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:13.221417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 577/1170] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:13.226676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:13.227066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:13.227219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:13.245773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:13.246933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:13.310056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 594/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 10:49:13.576175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1085ad-00ee-45dc-a8d4-a5e6ae217411 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:13.610868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:13.675040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1085ad-00ee-45dc-a8d4-a5e6ae217411 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:13.708680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e80d9e-7ce3-4619-b7da-1f2bae25ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:13.709299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e80d9e-7ce3-4619-b7da-1f2bae25ec48 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:13.709581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e80d9e-7ce3-4619-b7da-1f2bae25ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:13.709860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e80d9e-7ce3-4619-b7da-1f2bae25ec48 None admin] PATH_INFO: `/v3/domains/6e82fb4e14e141bb9ee892253a108094` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:13.719895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e80d9e-7ce3-4619-b7da-1f2bae25ec48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e82fb4e14e141bb9ee892253a108094)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:13.721363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e80d9e-7ce3-4619-b7da-1f2bae25ec48 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:13.722921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 578/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Sep 15 10:49:13 2022] GET /identity/v3/domains/6e82fb4e14e141bb9ee892253a108094 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:13.729409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:13.753131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:13.827623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ad10-570a-4771-b317-ae2d42f99bea None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:13.860514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d3a3-7c67-4155-9c47-e33a8d8171be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:13.861119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d3a3-7c67-4155-9c47-e33a8d8171be None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:13.861398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d3a3-7c67-4155-9c47-e33a8d8171be None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:13.861672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d3a3-7c67-4155-9c47-e33a8d8171be None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:13.862322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435d3a3-7c67-4155-9c47-e33a8d8171be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:13.863727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435d3a3-7c67-4155-9c47-e33a8d8171be None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:13.982168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 595/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:49:13 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:49:16.136107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089a437-3a69-49c0-9351-f618a355aaa4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:16.136698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089a437-3a69-49c0-9351-f618a355aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:16.136698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089a437-3a69-49c0-9351-f618a355aaa4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:16.138033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 579/1174] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:16.143126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:16.143513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:16.143675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:16.161924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:16.163080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:16.227268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 596/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:16.495581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089a437-3a69-49c0-9351-f618a355aaa4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:16.590546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:16.596984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089a437-3a69-49c0-9351-f618a355aaa4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:16.630889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d457074-f569-42e6-96b6-d968515dfd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:16.631511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457074-f569-42e6-96b6-d968515dfd16 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:16.631803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457074-f569-42e6-96b6-d968515dfd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:16.632868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457074-f569-42e6-96b6-d968515dfd16 None admin] PATH_INFO: `/v3/domains/6e82fb4e14e141bb9ee892253a108094` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:16.634470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d457074-f569-42e6-96b6-d968515dfd16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e82fb4e14e141bb9ee892253a108094)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:16.635913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d457074-f569-42e6-96b6-d968515dfd16 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:16.637556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 580/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Sep 15 10:49:16 2022] GET /identity/v3/domains/6e82fb4e14e141bb9ee892253a108094 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:16.643291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:16.651267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:16.738028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42347954-80cd-4c71-942c-4cd88834aeb4 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:16.770202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b97519-c0a6-4966-9c77-5931599bf4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:16.770727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97519-c0a6-4966-9c77-5931599bf4d2 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:16.771000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97519-c0a6-4966-9c77-5931599bf4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:16.771269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97519-c0a6-4966-9c77-5931599bf4d2 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:16.771900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b97519-c0a6-4966-9c77-5931599bf4d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:16.773476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b97519-c0a6-4966-9c77-5931599bf4d2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:16.842585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 597/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:49:16 2022] POST /identity/v3/users => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:49:19.028673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fa16-015c-4b96-84d1-c709fcbb89c0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:19.029225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fa16-015c-4b96-84d1-c709fcbb89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:19.029225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fa16-015c-4b96-84d1-c709fcbb89c0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:19.030573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 581/1178] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:19.035940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:19.036363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:19.036509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:19.055198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:19.056384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:19.109680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:19.120792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 598/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:19.399287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335fa16-015c-4b96-84d1-c709fcbb89c0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:19.498591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335fa16-015c-4b96-84d1-c709fcbb89c0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:19.531841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:19.532478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:19.532762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:19.533037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:19.542822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:49:19.547587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:49:19.552411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:49:19.553519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 582/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:49:19.554705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:19.650178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1403a7-aed3-48c9-b7ea-69e48c95b71d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:19.681955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:19.682549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:19.682827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:19.683098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:19.683748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:19.684047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:19.685439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:19.693043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 599/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:49:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:19.699419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:19.724471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:19.797330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6346de-cf1f-4218-b11b-04e126e559e1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:19.830555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:19.831175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:19.831455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:19.831730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] PATH_INFO: `/v3/users/749c252bb9a64d708e0a0490493fd576` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:19.891109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] RBAC: Authorizing `identity:get_user(user_id=749c252bb9a64d708e0a0490493fd576)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:19.892573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:19.894173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 583/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:49:19 2022] GET /identity/v3/users/749c252bb9a64d708e0a0490493fd576 => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:19.901199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:19.954968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:19.999341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a592-1260-4a20-993d-b408bee41dfc None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:20.032919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:20.033536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:20.033818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:20.034096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:20.098522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:20.099963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:20.150910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:20.193728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 600/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:49:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:49:20.199866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:20.281063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:20.298263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c4ae-7073-4994-9b19-329ca9e01af6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:20.331470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6a6f-fa59-45e8-9f98-2bc83fc30177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:20.332093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6a6f-fa59-45e8-9f98-2bc83fc30177 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:20.332405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6a6f-fa59-45e8-9f98-2bc83fc30177 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:20.332687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6a6f-fa59-45e8-9f98-2bc83fc30177 None admin] PATH_INFO: `/v3/projects/83701cce44f74ae0b93598b8850c6ab9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:20.333795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6a6f-fa59-45e8-9f98-2bc83fc30177 None admin] RBAC: Authorizing `identity:get_project(project_id=83701cce44f74ae0b93598b8850c6ab9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:20.335812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6a6f-fa59-45e8-9f98-2bc83fc30177 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:20.337455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 584/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:49:20 2022] GET /identity/v3/projects/83701cce44f74ae0b93598b8850c6ab9 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:20.343646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:20.440291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06da86-1258-4f3c-b85b-f10780561015 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:20.474268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:20.474791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:20.475067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:20.475339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:20.476088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=83701cce44f74ae0b93598b8850c6ab9, user.id=749c252bb9a64d708e0a0490493fd576) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:20.476420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:20.477825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab1e-c8aa-4293-8b7a-7d74a629d372 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:20.482958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 601/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:49:20 2022] GET /identity/v3/role_assignments?user.id=749c252bb9a64d708e0a0490493fd576&scope.project.id=83701cce44f74ae0b93598b8850c6ab9&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:22.610253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dc1a7-2833-4cd3-997b-4b6acfb1dc23 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:22.610786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dc1a7-2833-4cd3-997b-4b6acfb1dc23 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:22.610786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dc1a7-2833-4cd3-997b-4b6acfb1dc23 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:22.612128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 585/1186] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:22.617519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:22.617923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:22.618068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:22.636213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:22.637417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:22.650619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:22.701191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 602/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:22.967449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dc1a7-2833-4cd3-997b-4b6acfb1dc23 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:23.068068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dc1a7-2833-4cd3-997b-4b6acfb1dc23 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:23.100653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:23.101362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:23.101650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:23.101924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:23.111565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:49:23.117137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:49:23.118233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:49:23.119298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 586/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:49:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:49:23.124216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:23.228500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7fbb4-a4b9-40b7-a3a5-57c4931f1838 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:23.261504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:23.262095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:23.262369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:23.262639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:23.263282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:23.263603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:23.264975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:23.272805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 603/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:49:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:23.279015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:23.291816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:23.376328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ba21a-69f3-42df-90b2-0340ce55730e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:23.409267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:23.409874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:23.410149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:23.410418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] PATH_INFO: `/v3/users/749c252bb9a64d708e0a0490493fd576` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:23.411499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] RBAC: Authorizing `identity:get_user(user_id=749c252bb9a64d708e0a0490493fd576)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:23.412938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:23.414663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 587/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:49:23 2022] GET /identity/v3/users/749c252bb9a64d708e0a0490493fd576 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:23.420356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:23.432806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:23.516417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ab1ef-a67c-4118-80bd-ec4caf3001b5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:23.547994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed657d4-63ac-4a12-bfaa-4a21b8d402cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:23.548668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed657d4-63ac-4a12-bfaa-4a21b8d402cf None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:23.548944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed657d4-63ac-4a12-bfaa-4a21b8d402cf None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:23.549213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed657d4-63ac-4a12-bfaa-4a21b8d402cf None admin] PATH_INFO: `/v3/projects/83701cce44f74ae0b93598b8850c6ab9` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:23.550300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed657d4-63ac-4a12-bfaa-4a21b8d402cf None admin] RBAC: Authorizing `identity:get_project(project_id=83701cce44f74ae0b93598b8850c6ab9)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:23.551701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed657d4-63ac-4a12-bfaa-4a21b8d402cf None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:23.553317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 604/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:49:23 2022] GET /identity/v3/projects/83701cce44f74ae0b93598b8850c6ab9 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:49:23.559264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:23.635985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:23.656177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d878431-bb31-454f-8f97-61b902a36743 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:23.689565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235e01-fa5b-4571-a7ca-c4bb42da2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:23.690201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235e01-fa5b-4571-a7ca-c4bb42da2347 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:23.690476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235e01-fa5b-4571-a7ca-c4bb42da2347 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:23.690747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235e01-fa5b-4571-a7ca-c4bb42da2347 None admin] PATH_INFO: `/v3/projects/83701cce44f74ae0b93598b8850c6ab9/users/749c252bb9a64d708e0a0490493fd576/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:23.692614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235e01-fa5b-4571-a7ca-c4bb42da2347 None admin] RBAC: Authorizing `identity:create_grant(project_id=83701cce44f74ae0b93598b8850c6ab9, user_id=749c252bb9a64d708e0a0490493fd576, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:23.694029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235e01-fa5b-4571-a7ca-c4bb42da2347 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:23.768899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 588/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:49:23 2022] PUT /identity/v3/projects/83701cce44f74ae0b93598b8850c6ab9/users/749c252bb9a64d708e0a0490493fd576/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 10:49:25.891069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925de5-394b-44d5-809d-ae8b5135c8f6 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:25.891632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925de5-394b-44d5-809d-ae8b5135c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:25.891632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925de5-394b-44d5-809d-ae8b5135c8f6 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:25.892994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 605/1193] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:49:25.898128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:25.898556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:25.898669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:25.916171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:49:25.917360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:49:25.981421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 589/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:49:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:49:26.248891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925de5-394b-44d5-809d-ae8b5135c8f6 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:26.327329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:26.348691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925de5-394b-44d5-809d-ae8b5135c8f6 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:26.382274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:26.382881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:26.383156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:26.383422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:26.393570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:49:26.398406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:49:26.399521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:49:26.400413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 606/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:49:26.405522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:26.468509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:26.501341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81f72a-5853-451f-9988-7d194284d6e1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:26.533699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:26.534290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:26.534564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:26.534834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:26.535482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:26.535779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:26.537158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:26.545506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 590/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:49:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:26.551444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:26.645969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de89ba-56d1-4b2c-997f-4a33e160854b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:26.679830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:26.680467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:26.680747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:26.681023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] PATH_INFO: `/v3/users/749c252bb9a64d708e0a0490493fd576` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:26.682122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] RBAC: Authorizing `identity:get_user(user_id=749c252bb9a64d708e0a0490493fd576)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:26.683523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:26.685106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 607/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Sep 15 10:49:26 2022] GET /identity/v3/users/749c252bb9a64d708e0a0490493fd576 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:26.690851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:26.789554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9dc46-4479-4ba5-b7b0-954f043f07d1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:26.816438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:26.822130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:26.822728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:26.823010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:26.823287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:26.889008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:26.890450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:26.985697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 591/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:49:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:49:26.992052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:27.002049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:27.090480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24af8-56fa-4938-af78-c7accd5cd6ae None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:27.122601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dbfbe-ba01-463b-85f7-a3f78b6b2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:27.123217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dbfbe-ba01-463b-85f7-a3f78b6b2d01 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:27.123499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dbfbe-ba01-463b-85f7-a3f78b6b2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:27.123774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dbfbe-ba01-463b-85f7-a3f78b6b2d01 None admin] PATH_INFO: `/v3/projects/83701cce44f74ae0b93598b8850c6ab9` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:27.124889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dbfbe-ba01-463b-85f7-a3f78b6b2d01 None admin] RBAC: Authorizing `identity:get_project(project_id=83701cce44f74ae0b93598b8850c6ab9)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:27.126296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dbfbe-ba01-463b-85f7-a3f78b6b2d01 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:27.127903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 608/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Sep 15 10:49:26 2022] GET /identity/v3/projects/83701cce44f74ae0b93598b8850c6ab9 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:49:27.134645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:49:27.165673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:27.246584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89131-fa9a-45ba-9b0a-c2076552b423 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:49:27.283717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:49:27.284330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:49:27.284631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:49:27.284901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:49:27.285617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=83701cce44f74ae0b93598b8850c6ab9, user.id=749c252bb9a64d708e0a0490493fd576) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:49:27.285919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:49:27.287336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0805c9-c18b-4577-afc9-05d0633cd3d4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:49:27.293031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 592/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:49:27 2022] GET /identity/v3/role_assignments?user.id=749c252bb9a64d708e0a0490493fd576&scope.project.id=83701cce44f74ae0b93598b8850c6ab9&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:49:37.118496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=63 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:49:37.290511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=53 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:40.330242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ba3ad-aeef-4057-955e-c58f24b06fae None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:40.330845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ba3ad-aeef-4057-955e-c58f24b06fae None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:40.330845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ba3ad-aeef-4057-955e-c58f24b06fae None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:40.332085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 609/1201] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:50:40.337976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:40.338433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:40.338532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:40.356733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:50:40.357919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:50:40.424388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 593/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:50:40.702900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ba3ad-aeef-4057-955e-c58f24b06fae None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:40.800891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ba3ad-aeef-4057-955e-c58f24b06fae None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:40.832857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:40.833463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:40.833737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:40.834005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:40.846597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:40.848050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:40.862818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:40.871021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:40.872012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:40.872012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:40.872012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:40.872012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 610/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:40.872267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:40.968280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa465-3396-4042-b942-c21a5fc32a67 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:40.997505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:41.003168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:41.004574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:41.004574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:41.004574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:41.004990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:41.005311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:41.006754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b551028-8783-4b8e-8ec3-2b7a42e1ff97 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:41.018114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 594/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:50:41.023899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:41.077862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:41.122409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65afbfa-5ec8-4b4f-8122-95bbc5691baa None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:41.154935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dd0a2-e74f-4082-96c8-d31fd027cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:41.155564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd0a2-e74f-4082-96c8-d31fd027cd26 None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:41.155851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd0a2-e74f-4082-96c8-d31fd027cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:41.156125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dd0a2-e74f-4082-96c8-d31fd027cd26 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:41.156826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dd0a2-e74f-4082-96c8-d31fd027cd26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:41.158293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dd0a2-e74f-4082-96c8-d31fd027cd26 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:41.275610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 611/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Sep 15 10:50:41 2022] POST /identity/v3/users => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:50:43.452260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275fac-fcdb-4d7f-a2fa-69a9f15c8c6c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:43.452888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275fac-fcdb-4d7f-a2fa-69a9f15c8c6c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:43.452888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275fac-fcdb-4d7f-a2fa-69a9f15c8c6c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:43.454203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 595/1206] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:50:43.459314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:43.459751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:43.459860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:43.479051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:50:43.482191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:50:43.544932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 612/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:50:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:50:43.826568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275fac-fcdb-4d7f-a2fa-69a9f15c8c6c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:43.927340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275fac-fcdb-4d7f-a2fa-69a9f15c8c6c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:43.966626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:43.967280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:43.967644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:43.967910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:43.985991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:50:43.991141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:43.992756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:43.994558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 596/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:50:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:43.999485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:44.042009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:44.100326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d57b89-7d6a-4e6b-9187-1b92638a6ada None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:44.139942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:44.140823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:44.141482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:44.141882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:44.142557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:44.142850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:44.144282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:44.153489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 613/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:50:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:44.160087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:44.215328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:44.283401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7a096-9e83-4d3f-a082-14c65d73e8f2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:44.319972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:44.320633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:44.320917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:44.321202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:44.335964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:44.338490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:44.368810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:44.370802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:44.373031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:44.373031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:44.373031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:44.373031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 597/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:44.373319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:44.476643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:44.481039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe07f1-2750-46bd-8007-dbcb9c1ec37e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:44.518761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:44.519369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:44.519653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:44.519929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:44.520600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:44.520894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:44.522255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:44.547519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 614/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:44.552928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:44.669259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a9859-544b-4dcc-8a1c-ff44a4ea3ec0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:44.670720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:44.707867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:44.708759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:44.709240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:44.709773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:44.719174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:44.720651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:50:44.735111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:44.740297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:44.741515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 598/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:44.743110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:44.869568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309cc8-864b-494a-9336-b15cefddbdd2 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:44.917999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:44.918963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:44.919494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:44.919895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:44.921162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:44.921647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:44.923855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:44.947619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 615/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 15 10:50:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:50:44.958063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:45.066384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af9ff1-adde-4cc5-bfb0-6baa333d0a48 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:45.100095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:45.100727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:45.101027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:45.101288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:45.130662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:45.168114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:45.169758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:45.269277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 599/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:50:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:50:45.276515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:45.295301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:45.376315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15991ea9-f3de-4071-b57a-8ecfa60cf04f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:45.410311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:45.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:45.411230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:45.411502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:45.422159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:45.422926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:45.436979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:45.438073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:45.439471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:45.439471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:45.439471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:45.439471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 616/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:50:45.443790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:45.505549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:45.543814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa3bc-3fe6-4459-beed-f422055dc1c1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:45.578282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:45.578877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:45.579154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:45.579426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:45.580089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:45.580420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:45.581769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:45.593602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 600/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:45.599281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:45.667437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:45.699094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438770b0-7914-43ad-a225-c89b1989276a None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:45.734821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:45.735439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:45.735717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:45.735987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:45.742626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:45.744137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:50:45.755980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:45.757102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:45.758164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 617/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:45.763292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:45.862990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e03fcd-09b3-4b6e-8f5c-43e2e6436aca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:45.884275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:45.895715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:45.896355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:45.896644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:45.896923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:45.897608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:45.897916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:45.899358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e161cdf-7767-4bd8-ad74-bccad645ce92 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:45.912765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 601/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:45.919626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:46.019066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f601ea-ece0-4694-8aeb-60433c85d42f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:46.051201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:46.057319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:46.057921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:46.058201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:46.058473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:46.059193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=ee29a4f477544f63be347989e4b549cb) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:46.059500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:46.060964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4505732-0551-4310-a271-9983f5babf6a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:46.066365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 618/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:50:45 2022] GET /identity/v3/role_assignments?user.id=ee29a4f477544f63be347989e4b549cb&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:48.181806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef4a4-5f13-4c0b-8bac-3ecc8eeb2b2f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:48.182377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef4a4-5f13-4c0b-8bac-3ecc8eeb2b2f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:48.182377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaef4a4-5f13-4c0b-8bac-3ecc8eeb2b2f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:48.183774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 602/1220] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:50:48.188965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:48.189392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:48.189518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:48.208235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:50:48.209432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:50:48.274081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 619/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:50:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:50:48.548436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef4a4-5f13-4c0b-8bac-3ecc8eeb2b2f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:48.656734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaef4a4-5f13-4c0b-8bac-3ecc8eeb2b2f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:48.690292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:48.690974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:48.691250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:48.691525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:48.701934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:50:48.706638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:48.707727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:48.709044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 603/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:48.713947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:48.812079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8b5f7-aac3-4113-baae-0df9f942f133 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:48.835164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:48.845223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:48.845847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:48.846124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:48.846406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:48.847043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:48.847341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:48.848722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:48.856214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 620/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:48.862258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:48.909107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:48.974008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043254b2-4e5f-42d8-b273-29e9097b9b3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.008224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.008874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.009150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.009507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.019108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.020572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:49.034594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:49.035789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:49.036796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:49.036796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:49.036796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:49.036796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 604/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:49.042148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:49.139324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dfa72-a18a-4929-858d-a07a0467dcf1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.175006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.175606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.175882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.176152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.176820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:49.177121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.178462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:49.190813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 621/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:50:49.197057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:49.294656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:49.301106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021e2d-67cb-40ba-88ec-7532031b2499 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.333473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.334090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.334371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.334647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.343100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.351925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:50:49.356554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:49.357673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:49.358641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 605/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:49.363906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:49.409136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:49.459409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2172-d897-44af-8e92-73a42409fd81 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.492529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.493125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.493402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.493744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.494621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:49.494922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.496342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:49.513534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 622/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 15 10:50:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:49.519570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:49.623302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f9fea-d74d-4445-b12b-cec95d6fb248 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.656722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.657394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.657678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.657956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.669148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.670522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:49.684577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:49.685774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:49.686915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:49.686915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:49.686915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:49.686915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 606/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:49.691660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:49.792266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733eef-936d-40d3-b570-2d02e917a188 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.794572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:49.827075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.827666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.827939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.828208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.828873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:49.829168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.830549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:49.843709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 623/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:49.849634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:49.859419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:49.949434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d158c-00e9-4654-9fef-2e5292fb2461 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:49.982411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:49.983028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:49.983305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:49.983577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:49.990200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:49.991623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:50:50.008261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:50.014362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:50.015535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 607/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:50.016788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:50.113960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b291b4-f9bf-4d66-bcfd-8ce7893db03b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:50.148594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:50.149196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:50.149476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:50.149750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:50.150474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:50.150771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:50.152179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44ff8-9876-49b9-9304-a67621eee580 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:50.163781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 624/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 10:50:50.169899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:50.235025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:50.269622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcd0c8-d35e-460f-a20b-94c5dec2d6ed None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:50.302848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b24632-e8a3-416f-9883-603c8c042e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:50.309711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b24632-e8a3-416f-9883-603c8c042e94 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:50.309711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b24632-e8a3-416f-9883-603c8c042e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:50.309711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b24632-e8a3-416f-9883-603c8c042e94 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/ee29a4f477544f63be347989e4b549cb/roles/3644a59dae554c16b7ef527e2d206cbc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:50.318439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b24632-e8a3-416f-9883-603c8c042e94 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=ee29a4f477544f63be347989e4b549cb, role_id=3644a59dae554c16b7ef527e2d206cbc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:50.319874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b24632-e8a3-416f-9883-603c8c042e94 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:50.391024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 608/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:50:50 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/ee29a4f477544f63be347989e4b549cb/roles/3644a59dae554c16b7ef527e2d206cbc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:50:52.503091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb86bd-0f57-40ff-a8ff-d36984b1153e None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:52.503637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb86bd-0f57-40ff-a8ff-d36984b1153e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:52.503637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb86bd-0f57-40ff-a8ff-d36984b1153e None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:52.505028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 625/1233] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:50:52.510230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:52.510647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:52.512278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:52.528740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:50:52.529895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:50:52.596488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 609/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:50:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:50:52.868033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb86bd-0f57-40ff-a8ff-d36984b1153e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:52.893645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:52.974903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb86bd-0f57-40ff-a8ff-d36984b1153e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:53.008614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:53.010107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:53.010393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:53.010668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:53.020634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:50:53.026139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:53.027370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:53.028363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 626/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Sep 15 10:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:53.033356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:53.079548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:53.131326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb36eb-81df-4234-ad75-00d825c6a913 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:53.165571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:53.166172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:53.166427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:53.166702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:53.167368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:53.167672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:53.169064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:53.176847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 610/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Sep 15 10:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:53.183741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:53.273610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:53.289103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6a541-4825-4b4b-89c0-3c20660d3dff None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:53.322230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:53.322857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:53.323132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:53.323398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:53.333487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:53.334905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:53.348803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:53.350016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:53.350931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:53.350931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:53.350931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:53.350931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 627/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:53.355977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:53.457305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338aa0-0c8e-4d67-804f-72472e6855a4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:53.466067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:53.491258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:53.491863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:53.492147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:53.492457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:53.493097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:53.493424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:53.495291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:53.506751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 611/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:53.512636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:53.645634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12127-6142-42c7-8355-48902fae16e1 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:53.679617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:53.680240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:53.680546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:53.680819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:53.684021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:53.689552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:53.690971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:50:53.701787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:53.702863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:53.704245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 628/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:53.708735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:53.818148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480236c-e1b1-4b2d-a8a6-d45c234dcab1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:53.855854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:53.856509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:53.857982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:53.857982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:53.858638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:53.859734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:53.867352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:53.889918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 612/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 15 10:50:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:53.896052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:53.992516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec9b4-8e31-4ceb-85a7-8f341d7a7c8e None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:54.027253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:54.027876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:54.028149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:54.028456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:54.088199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:54.094511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:54.095936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:54.198999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 629/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:50:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:50:54.205148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:54.233069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:54.304030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624601-744d-434a-93b3-2b598f0cf6c9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:54.336327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:54.336961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:54.338076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:54.338452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:54.349109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:54.352341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:54.365878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:54.367066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:54.368143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:54.368143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:54.368143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:54.368143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 613/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:54.373143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:54.507210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:54.513742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3784b-e876-40a8-b8ef-f2c230cde96f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:54.547254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:54.547865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:54.548136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:54.548436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:54.549067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:54.549367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:54.550707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:54.562527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 630/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:54.568411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:54.651644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:54.673813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc8039-9832-4913-9c87-4fc69f158fb4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:54.709688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:54.712483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:54.712483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:54.712483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:54.719487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:54.728114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:50:54.748927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:54.752858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:54.753953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 614/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:54.756024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:54.855314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25f6d-19a7-437c-a463-f7b21bfa358f None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:54.890248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:54.890842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:54.891117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:54.891385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:54.892095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:54.892431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:54.893831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a817c6c-9f7c-47dd-a128-93967f7f2a96 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:54.905592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 631/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:54.911741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:55.013445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103249-411b-4b3c-b4c2-7b03b08af13c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:55.046463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:55.047111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:55.047387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:55.047660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:55.048418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] RBAC: Adding query filter params (role.id=3644a59dae554c16b7ef527e2d206cbc, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=ee29a4f477544f63be347989e4b549cb) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:55.048724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:55.050201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589a590-9a5e-44c3-a55f-7903ab95cb03 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:55.056773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 615/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:50:54 2022] GET /identity/v3/role_assignments?user.id=ee29a4f477544f63be347989e4b549cb&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=3644a59dae554c16b7ef527e2d206cbc => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:57.254833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37bf5-b6b6-44bc-9d98-064ef0620e7f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:57.255358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37bf5-b6b6-44bc-9d98-064ef0620e7f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:57.255358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37bf5-b6b6-44bc-9d98-064ef0620e7f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:57.256738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 632/1247] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:50:57.262633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:57.263040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:57.263174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:57.269574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:57.282703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:50:57.283841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:50:57.351545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 616/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:50:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:50:57.620632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37bf5-b6b6-44bc-9d98-064ef0620e7f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:57.638262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:57.718504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37bf5-b6b6-44bc-9d98-064ef0620e7f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:57.752387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:57.753009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:57.753442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:57.753600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:57.764690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:50:57.769579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:57.770774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:57.771951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 633/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:50:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:50:57.777403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:57.880496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90e79a-ceba-4905-8d8a-810d3a2d1048 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:57.915920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:57.920921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:57.921644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:57.921929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:57.922207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:57.922873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:57.923179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:57.924572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:57.933501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 617/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:50:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:57.939373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:58.015391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:58.037198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5836c-6f64-47d7-80ba-7b96dc031686 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:58.070611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:58.071226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:58.071539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:58.071807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:58.082436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:58.083840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:58.097576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:58.098707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:58.099997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:58.099997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:58.099997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:58.099997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 634/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:58.105136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:58.204517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab756e-6652-455d-9f23-8a70dd24fadb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:58.237120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:58.237708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:58.238245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:58.238513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:58.239136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:58.239432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:58.240845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:58.252301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 618/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:58.258109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:58.356325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ef775-ef2e-4201-ae30-d04cbb94d428 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:58.381826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:58.389200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:58.389812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:58.390084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:58.390353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:58.397702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:58.398719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:50:58.409994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:58.410954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:50:58.412091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 635/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:58.417728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:58.474745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:58.518610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164137b-11f8-4ce8-944b-908740d96bfd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:58.550998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:58.551586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:58.551861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:58.552131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:58.552978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:58.553478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:58.556235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:58.574203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 619/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 15 10:50:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:58.583264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:58.682030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531330-073d-4636-a128-f20cb8a66cf3 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:58.714277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:58.714867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:58.715143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:58.715412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:58.768827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:58.780521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:58.781944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:58.877830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 636/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:50:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:50:58.884026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:58.984580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c234-5f91-4186-ab8f-40884b96adb6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:58.998430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:59.019115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:59.019680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:59.019962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:59.020239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:59.030871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:59.032325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:50:59.047729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:59.050329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:50:59.051266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:50:59.051266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:50:59.051266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:59.051266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 620/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:59.054858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:59.142013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:59.154516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41f3ee-7e05-437f-9e89-21e87669722b None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:59.189093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:59.189730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:59.190207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:59.190639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:59.191646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:59.191944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:59.193315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:59.205418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 637/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:59.211183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:59.311084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588985-0ad9-4cb6-82f0-fdeda5f001aa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:59.343817 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:59.344459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:59.344738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:59.345012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:59.351375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:59.352835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:50:59.364846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:50:59.365903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:50:59.367176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 621/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:50:59.372170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:59.475555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f684e-1b57-40cc-835c-bc604b338e83 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:59.508181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:59.508805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:59.509080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:59.509350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:59.510023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:59.512527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:59.512527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab319-5940-4653-a64c-bc79b69185c8 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:59.523698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 638/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:50:59.530511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:50:59.555894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:50:59.630071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f78591-6822-4656-a339-7d07a38b584f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:50:59.664042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:50:59.664668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:50:59.664949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:50:59.665224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:50:59.665938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=ee29a4f477544f63be347989e4b549cb) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:50:59.666249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:50:59.668103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912dda-6616-49f8-a875-630fb2e639b5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:50:59.673338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 622/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:50:59 2022] GET /identity/v3/role_assignments?user.id=ee29a4f477544f63be347989e4b549cb&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:01.815306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5209-fd8c-4cc1-acdc-d877e54ba78c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:01.815874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5209-fd8c-4cc1-acdc-d877e54ba78c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:01.815874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5209-fd8c-4cc1-acdc-d877e54ba78c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:01.817361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 639/1261] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:51:01.822611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:01.823068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:01.823162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:01.841313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:51:01.843392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:51:01.911060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 623/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:51:02.184641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5209-fd8c-4cc1-acdc-d877e54ba78c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:02.195816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:02.285988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5209-fd8c-4cc1-acdc-d877e54ba78c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:02.319545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:02.320163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:02.320514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:02.320791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:02.330721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:51:02.335572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:02.336716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:02.337987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 640/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:02.343230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:02.361320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:02.438282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8beea-2546-49e2-88c1-4dfd08d6ee03 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:02.472006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:02.472629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:02.472905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:02.473176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:02.473823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:02.474116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:02.475468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:02.483368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 624/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:02.491036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:02.554637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:02.586761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436c99f-845b-4159-97c2-31c09b322cb2 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:02.653590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:02.654218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:02.654787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:02.655144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:02.665392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:02.667155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:51:02.681443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:02.682497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:51:02.683412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:51:02.683412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:02.683412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:02.683412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 641/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 10:51:02.694561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:02.769965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:02.788922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563466a6-23a7-492f-9486-dc22a368ec8b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:02.821554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:02.822163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:02.823071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:02.823664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:02.824400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:02.824713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:02.826075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:02.837527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 625/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:02.843306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:02.944491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08021f-39f8-48fe-85d4-c66df2781a5d None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:02.964638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:02.983186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:02.983819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:02.984100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:02.984404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:02.992532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:02.993949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:51:03.006015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:03.007164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:03.008340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 642/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:51:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:03.013716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:03.114289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdebe5-5060-4162-9fa9-599313775992 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:03.148767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:03.149369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:03.149645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:03.149917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:03.150637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:03.150933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:03.152475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:03.160938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:03.169616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 626/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 15 10:51:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:03.175387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:03.275405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a31b7-030d-406b-ac1b-bb1c386cb2ed None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:03.309604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:03.310215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:03.310491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:03.313222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:03.320972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:03.322907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:51:03.337178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:03.338144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:51:03.339092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:51:03.339092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:03.339092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:03.339092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 643/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:03.344690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:03.442777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14dec-d420-4bbd-b857-be9205629bd3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:03.476845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:03.477446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:03.477726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:03.477997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:03.478674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:03.479302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:03.480490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:03.491766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 627/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:03.497684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:03.528890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:03.595340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37c1d7-c3cf-4b1c-b7f9-519d28b94d72 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:03.628661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:03.629297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:03.629563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:03.629837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:03.636951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:03.638560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:51:03.649450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:03.650550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:03.651676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 644/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:03.656683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:03.714982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:03.756828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9588c-0d58-4e9f-9f77-f29fe0cacbae None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:03.789461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:03.790009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:03.790302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:03.790571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:03.791839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:03.792144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:03.793926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4bb30-d07a-46c1-91b0-7d986828a455 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:03.806285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 628/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:03.812507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:03.904204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:03.914342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd386-eb4f-42df-bfae-f565169cf117 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:03.955795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae07eef-22e5-42af-88f4-5ec7b7f00be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:03.956480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07eef-22e5-42af-88f4-5ec7b7f00be9 None admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:03.956763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07eef-22e5-42af-88f4-5ec7b7f00be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:03.957038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07eef-22e5-42af-88f4-5ec7b7f00be9 None admin] PATH_INFO: `/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/ee29a4f477544f63be347989e4b549cb/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:03.958936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae07eef-22e5-42af-88f4-5ec7b7f00be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a37f691aef43b18eddf83d65eccbd2, user_id=ee29a4f477544f63be347989e4b549cb, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:03.960512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae07eef-22e5-42af-88f4-5ec7b7f00be9 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:04.081796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 645/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Sep 15 10:51:03 2022] PUT /identity/v3/projects/30a37f691aef43b18eddf83d65eccbd2/users/ee29a4f477544f63be347989e4b549cb/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 10:51:06.214393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac898-6255-47b4-ba06-3c4923fdd77b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:06.214916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac898-6255-47b4-ba06-3c4923fdd77b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:06.214916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac898-6255-47b4-ba06-3c4923fdd77b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:06.216298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 629/1274] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:51:06.222040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:06.222437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:06.222628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:06.240831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:51:06.242000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:51:06.307521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 646/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:51:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:51:06.576083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac898-6255-47b4-ba06-3c4923fdd77b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:06.679576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac898-6255-47b4-ba06-3c4923fdd77b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:06.697907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:06.714689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:06.715313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:06.715593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:06.715867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:06.726120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 10:51:06.733093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:06.734173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:06.735064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 630/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Sep 15 10:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:06.739333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:06.819712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:06.836656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bb29a-3f3e-408e-8458-4b4ae94c68bb None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:06.869958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:06.870549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:06.870823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:06.871090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:06.871736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:06.872029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:06.873401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:06.881685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 647/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Sep 15 10:51:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:06.888290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:06.986941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b72fa0-787e-46c5-a860-ee857197b65b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:07.019855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:07.020500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:07.020781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:07.021054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:07.033613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:07.035138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:51:07.050106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:07.051251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:51:07.052153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:51:07.052153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:07.052153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:07.055960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 631/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:07.057231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:07.158280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564990e-bea9-49f1-bba0-062d3b1627f5 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:07.192329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:07.192978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:07.193256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:07.193525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:07.194169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:07.194465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:07.195849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:07.214860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 648/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:07.216113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:07.249034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:07.325444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d4d35-2f89-4613-bf53-1601552a8aa5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:07.360714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:07.361356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:07.361633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:07.361901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:07.370736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:07.372205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 10:51:07.384564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:07.386005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:07.387014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 632/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:51:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:07.392340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:07.396194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:07.499856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d0cf-f669-4729-b58a-9a0a8d62c903 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:07.534623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:07.535297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:07.535600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:07.535874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:07.536621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:07.536621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:07.538437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:07.555883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 649/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Sep 15 10:51:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:07.561918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:07.658916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:07.668918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1b7a7-cb8f-4201-aa94-ed5e6a013f9a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:07.701878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:07.702478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:07.702813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:07.707820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:07.772275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:07.773941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:07.861349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:07.872405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 633/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Sep 15 10:51:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 10:51:07.878368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:07.948627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:07.985470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567c4c9-c8d6-4a30-9f51-4f3ef3ef2eee None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:08.018690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:08.019304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:08.019578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:08.019846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:08.030423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:08.031869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 10:51:08.047351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:08.048540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 10:51:08.049665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 10:51:08.049665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 10:51:08.049665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:08.049665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 650/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 10:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:08.054195 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:08.152165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fece9-bbcd-44f7-9e37-6cec4c7af468 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:08.185071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:08.185663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:08.185938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:08.186210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:08.186838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:08.187131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:08.188503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:08.199296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 634/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Sep 15 10:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:08.205202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:08.334080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4c985-ba12-4421-a01b-a5b536f94130 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:08.352678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:08.372476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:08.373091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:08.373366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:08.373632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:08.379955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:08.381399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 10:51:08.392867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:08.394399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: ERROR keystone.server.flask.application Sep 15 10:51:08.395504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 651/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Sep 15 10:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:08.400028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:08.453211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:08.500154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedb8d2-30f6-443a-97c4-4e97ad2d5f77 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:08.533545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:08.534136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:08.534426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:08.534762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:08.535442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:08.535745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:08.537185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116f5b8-de8a-4629-ac54-1e7901d7992d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:08.549006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 635/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Sep 15 10:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:08.555139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:08.656578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7445-b46c-4692-b03e-c619960da7bf None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:08.690882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:08.691527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:08.691800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:08.692066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:08.692802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] RBAC: Adding query filter params (role.id=685ec3352bf148c5ad1012dcd25dc881, scope.project.id=30a37f691aef43b18eddf83d65eccbd2, user.id=ee29a4f477544f63be347989e4b549cb) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:08.693103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:08.694520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84250c5b-5f92-4680-bac3-15892231ef2e None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:08.700282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 652/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Sep 15 10:51:08 2022] GET /identity/v3/role_assignments?user.id=ee29a4f477544f63be347989e4b549cb&scope.project.id=30a37f691aef43b18eddf83d65eccbd2&role.id=685ec3352bf148c5ad1012dcd25dc881 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:10.937815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac7b4-8b76-40d2-926c-bad9d64acf2a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:10.938412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac7b4-8b76-40d2-926c-bad9d64acf2a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:10.938412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac7b4-8b76-40d2-926c-bad9d64acf2a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:10.939727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 636/1288] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:51:10.944846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:10.945265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:10.949911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:10.963929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:51:10.965272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:51:10.997176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:11.034976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 653/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:51:11.299509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac7b4-8b76-40d2-926c-bad9d64acf2a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:11.409154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac7b4-8b76-40d2-926c-bad9d64acf2a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:11.420272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:11.443355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:11.444053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:11.444632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:11.445171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:11.446080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:11.447593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:11.456481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:11.459522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:11.460690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 637/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:51:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:11.463870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:11.560694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c009-c8fe-465b-9e96-fb3e9794fe1c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:11.595853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:11.596482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:11.596765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:11.597044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:11.597681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:11.597985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:11.599425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41cf2-9436-4d34-94a6-d0285bfb6e77 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:11.607721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 654/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 15 10:51:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:11.613909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:11.715634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8771b3-52a7-4c21-961b-1a42321e3272 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:11.749835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:11.750434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:11.750720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:11.751023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:11.751687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] RBAC: Adding query filter params (type=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:11.751993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:11.753456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778bb3c-f28d-4304-a537-f73c1f9a55aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:11.760702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 638/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 15 10:51:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:13.932282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df388455-444c-4932-89b4-739518480d5f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:13.932866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df388455-444c-4932-89b4-739518480d5f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:13.932866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df388455-444c-4932-89b4-739518480d5f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:13.934183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 655/1293] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:51:13.941532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735766-b41b-4504-a5cd-1fb3b02265a7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:13.941532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735766-b41b-4504-a5cd-1fb3b02265a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:13.941532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735766-b41b-4504-a5cd-1fb3b02265a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:13.961381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1c735766-b41b-4504-a5cd-1fb3b02265a7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:51:13.964041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1c735766-b41b-4504-a5cd-1fb3b02265a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:51:13.997065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:14.036002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 639/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:51:14.308803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df388455-444c-4932-89b4-739518480d5f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:14.339496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:14.406809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df388455-444c-4932-89b4-739518480d5f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:14.440136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cfe2e-7232-44ca-98b7-7de97a5db43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:14.440769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cfe2e-7232-44ca-98b7-7de97a5db43f None admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:14.441054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cfe2e-7232-44ca-98b7-7de97a5db43f None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:14.441330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cfe2e-7232-44ca-98b7-7de97a5db43f None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:14.441984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cfe2e-7232-44ca-98b7-7de97a5db43f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:14.443327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cfe2e-7232-44ca-98b7-7de97a5db43f None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:14.515404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 656/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Sep 15 10:51:14 2022] POST /identity/v3/services => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:51:16.678183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72b2f-f9ad-4757-89f0-db733d8349f5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:16.678739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72b2f-f9ad-4757-89f0-db733d8349f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:16.678739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72b2f-f9ad-4757-89f0-db733d8349f5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:16.680065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 640/1296] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:51:16.685956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:16.686357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:16.686503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:16.704182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:51:16.705371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:51:16.779196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 657/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:51:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:51:17.046625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72b2f-f9ad-4757-89f0-db733d8349f5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:17.146435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72b2f-f9ad-4757-89f0-db733d8349f5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:17.180867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:17.181700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:17.181983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:17.182257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:17.182836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:17.184190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:17.192935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:17.193946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:17.195105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 641/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:51:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:17.200113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:17.218822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:17.295827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34687af5-406d-463c-b548-3dd64a383e35 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:17.329017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:17.329609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:17.329885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:17.330154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:17.330767 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:17.331063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:17.332426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:17.337387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 658/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 15 10:51:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:17.343397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:17.375453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:17.443536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee8bf4-f808-4827-8507-6c083d9bcd3a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:17.476989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:17.477578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:17.478396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:17.478863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:17.479600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] RBAC: Adding query filter params (interface=public, service_id=e1502325a30d4f3594faa6c0de0c93d2, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:17.479907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:17.481374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065fc1-ac32-4430-888b-5a354080ff2e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:17.486228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 642/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Sep 15 10:51:17 2022] GET /identity/v3/endpoints?service_id=e1502325a30d4f3594faa6c0de0c93d2&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:17.492115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:17.570969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:17.588351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23473791-e55b-4dc3-8c0c-aaaeec0fe955 None admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:17.622259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c7a72-38dc-4c95-aa69-ddbcb34f5811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:17.622854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c7a72-38dc-4c95-aa69-ddbcb34f5811 None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:17.623128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c7a72-38dc-4c95-aa69-ddbcb34f5811 None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:17.623397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c7a72-38dc-4c95-aa69-ddbcb34f5811 None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:17.623982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c7a72-38dc-4c95-aa69-ddbcb34f5811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:17.625360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c7a72-38dc-4c95-aa69-ddbcb34f5811 None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:17.631916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 659/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Sep 15 10:51:17 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 10:51:19.765585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e2ab-6498-407d-9bd8-5b0ef6a42d6b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:19.766119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e2ab-6498-407d-9bd8-5b0ef6a42d6b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:19.766232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e2ab-6498-407d-9bd8-5b0ef6a42d6b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:19.767475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 643/1302] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:51:19.772617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:19.772998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:19.773157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:19.791653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:51:19.792834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:51:19.858248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 660/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:51:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 10:51:20.153273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03e2ab-6498-407d-9bd8-5b0ef6a42d6b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:20.264272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:20.270835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03e2ab-6498-407d-9bd8-5b0ef6a42d6b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:20.303849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:20.304428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:20.304706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:20.304972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:20.305539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:20.307139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 10:51:20.315513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 10:51:20.316755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 15 10:51:20.317774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 644/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Sep 15 10:51:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 10:51:20.322812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:20.396618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:20.418849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19604fcd-dc24-4799-bbd1-ea2c5ebc4984 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:20.451306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:20.451906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:20.452189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:20.452496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] PATH_INFO: `/v3/services` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:20.453122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 10:51:20.453425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:20.454779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e33223-5920-4e5b-a9a6-abf3f0e5bd8a None admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:20.459721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 661/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Sep 15 10:51:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 10:51:20.466679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:51:20.565520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de4960-5847-4a4b-b9e8-0e64897439e1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:51:20.599157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c3d6-73d0-4c39-9046-ec0eafd124a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:51:20.599753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c3d6-73d0-4c39-9046-ec0eafd124a1 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:51:20.600039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c3d6-73d0-4c39-9046-ec0eafd124a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:51:20.600331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c3d6-73d0-4c39-9046-ec0eafd124a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:51:20.601000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07c3d6-73d0-4c39-9046-ec0eafd124a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:51:20.602339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07c3d6-73d0-4c39-9046-ec0eafd124a1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:51:20.707719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 645/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 10:51:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 10:51:30.469556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=30 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:51:30.706719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:05.000922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef29dee-e608-48e3-aa6c-f40c38a75b98 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:05.002409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef29dee-e608-48e3-aa6c-f40c38a75b98 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:05.003063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef29dee-e608-48e3-aa6c-f40c38a75b98 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:05.005792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 662/1307] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:05.011521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67482f77-a758-4be8-a81c-edc3bbbb50cf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:05.012074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67482f77-a758-4be8-a81c-edc3bbbb50cf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:05.012074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67482f77-a758-4be8-a81c-edc3bbbb50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:05.155940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-67482f77-a758-4be8-a81c-edc3bbbb50cf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:05.159151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-67482f77-a758-4be8-a81c-edc3bbbb50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:05.323869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 646/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:05.624121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f00744-10b0-48f6-8a56-9d51046399b8 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:05.624500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f00744-10b0-48f6-8a56-9d51046399b8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:05.624697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f00744-10b0-48f6-8a56-9d51046399b8 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:05.626271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 663/1309] 10.222.0.26 () {54 vars in 965 bytes} [Thu Sep 15 10:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:05.633556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f915-a35c-4fde-92e5-a0f5ee258f4a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:05.634136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f915-a35c-4fde-92e5-a0f5ee258f4a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:05.634639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70f915-a35c-4fde-92e5-a0f5ee258f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:05.737001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0c70f915-a35c-4fde-92e5-a0f5ee258f4a None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:05.738205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0c70f915-a35c-4fde-92e5-a0f5ee258f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:05.763919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:05.837711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 647/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Thu Sep 15 10:57:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:57:05.847269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f00744-10b0-48f6-8a56-9d51046399b8 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:05.849425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-70f00744-10b0-48f6-8a56-9d51046399b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:05.987081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f00744-10b0-48f6-8a56-9d51046399b8 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:06.080444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:06.081841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:06.082565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:06.083035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:06.085465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:06.149960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:06.221382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:06.223188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da8072-b22e-41ac-a0df-48121756df09 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:06.245012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 664/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:08.760968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f8191-5075-4821-b593-edecbbad341b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:08.761526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f8191-5075-4821-b593-edecbbad341b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:08.761526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f8191-5075-4821-b593-edecbbad341b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:08.762870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 648/1312] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:08.768116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4b9a3-1376-450c-ac5d-f1b83fab70f9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:08.768533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4b9a3-1376-450c-ac5d-f1b83fab70f9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:08.768716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4b9a3-1376-450c-ac5d-f1b83fab70f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:08.854761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4be4b9a3-1376-450c-ac5d-f1b83fab70f9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:08.855977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4be4b9a3-1376-450c-ac5d-f1b83fab70f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:08.949957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 665/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:09.238316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f8191-5075-4821-b593-edecbbad341b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:09.239882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-045f8191-5075-4821-b593-edecbbad341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:09.348252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f8191-5075-4821-b593-edecbbad341b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:09.420205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:09.422281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:09.422884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:09.423166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:09.423440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:09.425049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:09.535173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:09.536561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bfa06-6261-4864-8631-2734473bfa76 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:09.558094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 649/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:12.222463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681fde9-14d9-423a-82df-bf2a4311d634 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:12.222990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681fde9-14d9-423a-82df-bf2a4311d634 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:12.222990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681fde9-14d9-423a-82df-bf2a4311d634 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:12.224359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 666/1315] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:12.230131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb508-67c8-44d9-8beb-05d707089e09 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:12.230564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb508-67c8-44d9-8beb-05d707089e09 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:12.230661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb508-67c8-44d9-8beb-05d707089e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:12.297404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-935cb508-67c8-44d9-8beb-05d707089e09 None None] MFA Rules not processed for user `0c82e614439e49fc961d933b5aa45282`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:12.298521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-935cb508-67c8-44d9-8beb-05d707089e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:12.349841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:12.393094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 650/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:57:12.681575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681fde9-14d9-423a-82df-bf2a4311d634 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:12.683134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2681fde9-14d9-423a-82df-bf2a4311d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:12.692909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:12.785594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681fde9-14d9-423a-82df-bf2a4311d634 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:12.863837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:12.864459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:12.864736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:12.865007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:12.866857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:12.928276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:12.974038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:12.975565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00712c-5b1a-4f2b-99be-616b779669d2 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:12.993956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 667/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:15.915163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89b7aa-643c-4c08-9ff6-d417576cc74a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:15.915685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89b7aa-643c-4c08-9ff6-d417576cc74a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:15.915685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89b7aa-643c-4c08-9ff6-d417576cc74a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:15.917097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 651/1318] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:15.922143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f7a2-615e-437d-a8a7-3087ddca666e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:15.922566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f7a2-615e-437d-a8a7-3087ddca666e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:15.922678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f7a2-615e-437d-a8a7-3087ddca666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:15.987408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2047f7a2-615e-437d-a8a7-3087ddca666e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:15.988645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2047f7a2-615e-437d-a8a7-3087ddca666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:16.087881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 668/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:16.376808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89b7aa-643c-4c08-9ff6-d417576cc74a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:16.378338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9c89b7aa-643c-4c08-9ff6-d417576cc74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:16.479863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89b7aa-643c-4c08-9ff6-d417576cc74a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:16.553999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:16.554599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:16.554879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:16.555157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:16.556755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:16.563521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:16.664445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:16.665810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f91c3-49da-4d11-834d-e6ff4a2c1528 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:16.684444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 652/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:19.841998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28560449-337f-4d86-b1a7-421de156a701 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:19.842532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28560449-337f-4d86-b1a7-421de156a701 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:19.842532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28560449-337f-4d86-b1a7-421de156a701 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:19.844028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 669/1321] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:19.849289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2ab7f-d6cb-43bb-ab99-b5e56bf9cf5d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:19.849761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2ab7f-d6cb-43bb-ab99-b5e56bf9cf5d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:19.850601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2ab7f-d6cb-43bb-ab99-b5e56bf9cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:19.920348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-80a2ab7f-d6cb-43bb-ab99-b5e56bf9cf5d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:19.921565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80a2ab7f-d6cb-43bb-ab99-b5e56bf9cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:19.979606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:20.018487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 653/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:20.357735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3971dc-c3de-4a8f-b310-da8d25b4591d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:20.358007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3971dc-c3de-4a8f-b310-da8d25b4591d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:20.358274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3971dc-c3de-4a8f-b310-da8d25b4591d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:20.359612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 670/1323] 10.222.0.26 () {54 vars in 965 bytes} [Thu Sep 15 10:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:20.366810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70eb38-6d66-488f-9c6d-c28ad1ab46aa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:20.367098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70eb38-6d66-488f-9c6d-c28ad1ab46aa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:20.367376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70eb38-6d66-488f-9c6d-c28ad1ab46aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:20.442448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-eb70eb38-6d66-488f-9c6d-c28ad1ab46aa None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:20.443905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eb70eb38-6d66-488f-9c6d-c28ad1ab46aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:20.523901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 654/1324] 10.222.0.26 () {58 vars in 1062 bytes} [Thu Sep 15 10:57:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:20.532857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3971dc-c3de-4a8f-b310-da8d25b4591d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:20.534394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4b3971dc-c3de-4a8f-b310-da8d25b4591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:20.555490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:20.638450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3971dc-c3de-4a8f-b310-da8d25b4591d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:20.712991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:20.713872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:20.714323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:20.714594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:20.716184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:20.790331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:20.827403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:20.828880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0b4d-9f42-4001-9f27-41ef67876e32 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:20.847533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 671/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:23.294148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96efb31-b8ef-49dc-ba3d-0f127d34180a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:23.294710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96efb31-b8ef-49dc-ba3d-0f127d34180a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:23.294710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96efb31-b8ef-49dc-ba3d-0f127d34180a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:23.296038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 655/1326] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:23.301272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3c733-1f8f-44af-8655-eb1feba6f36a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:23.301723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3c733-1f8f-44af-8655-eb1feba6f36a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:23.301951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3c733-1f8f-44af-8655-eb1feba6f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:23.373462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ebd3c733-1f8f-44af-8655-eb1feba6f36a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:23.374677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ebd3c733-1f8f-44af-8655-eb1feba6f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:23.470321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 672/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:23.753562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96efb31-b8ef-49dc-ba3d-0f127d34180a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:23.755236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f96efb31-b8ef-49dc-ba3d-0f127d34180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:23.817928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:23.861750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96efb31-b8ef-49dc-ba3d-0f127d34180a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:23.938878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:23.939484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:23.939809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:23.940082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:23.941678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:24.054086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:24.056524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:24.057969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eb9bf-4c67-4998-acb2-afc122a3135a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:24.075655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 656/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:26.325595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd84b-6673-43ca-a992-c7f0e0c188b3 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:26.326148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd84b-6673-43ca-a992-c7f0e0c188b3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:26.326148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd84b-6673-43ca-a992-c7f0e0c188b3 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:26.327475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 673/1329] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:26.332765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3d12-d56e-48a7-94f8-86fc3d637dce None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:26.333203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3d12-d56e-48a7-94f8-86fc3d637dce None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:26.333308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3d12-d56e-48a7-94f8-86fc3d637dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:26.399911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b1cc3d12-d56e-48a7-94f8-86fc3d637dce None None] MFA Rules not processed for user `0c82e614439e49fc961d933b5aa45282`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:26.401137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b1cc3d12-d56e-48a7-94f8-86fc3d637dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:26.500628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 657/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:26.813379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd84b-6673-43ca-a992-c7f0e0c188b3 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:26.814889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bdbfd84b-6673-43ca-a992-c7f0e0c188b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:26.850714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:26.925218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd84b-6673-43ca-a992-c7f0e0c188b3 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:27.007790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:27.008514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:27.008792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:27.009080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:27.010668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:27.091685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:27.122447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:27.124184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3324f-4941-4535-8b90-d8330caa89de service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:27.143519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 674/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:29.749620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e238d-8ac7-4681-a72c-5b2b3291203e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:29.750224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e238d-8ac7-4681-a72c-5b2b3291203e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:29.750224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e238d-8ac7-4681-a72c-5b2b3291203e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:29.751507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 658/1332] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:29.757344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6013a-b53f-43c1-bf8e-66ca319e6f01 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:29.757789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6013a-b53f-43c1-bf8e-66ca319e6f01 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:29.757892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6013a-b53f-43c1-bf8e-66ca319e6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:29.822328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e5f6013a-b53f-43c1-bf8e-66ca319e6f01 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:29.823521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e5f6013a-b53f-43c1-bf8e-66ca319e6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:29.929389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 675/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:30.211787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e238d-8ac7-4681-a72c-5b2b3291203e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:30.213367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-987e238d-8ac7-4681-a72c-5b2b3291203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:30.284851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:30.318467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e238d-8ac7-4681-a72c-5b2b3291203e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:30.393553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:30.394154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:30.394434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:30.394706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:30.396937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:30.503804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:30.505260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a31fd-d0fe-4c34-9fe7-7357b4b829dd service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:30.515086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:30.523538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 659/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:32.763593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab1f2-de81-4190-b027-5bb77febf1e7 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:32.764125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab1f2-de81-4190-b027-5bb77febf1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:32.764125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab1f2-de81-4190-b027-5bb77febf1e7 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:32.765498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 676/1335] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:32.770876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863f39-074f-499f-9fb3-c467098c4aec None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:32.771796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863f39-074f-499f-9fb3-c467098c4aec None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:32.771953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863f39-074f-499f-9fb3-c467098c4aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:32.837747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-48863f39-074f-499f-9fb3-c467098c4aec None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:32.838847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-48863f39-074f-499f-9fb3-c467098c4aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:32.938313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 660/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:33.223470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab1f2-de81-4190-b027-5bb77febf1e7 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:33.226095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-207ab1f2-de81-4190-b027-5bb77febf1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:33.267254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:33.330881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab1f2-de81-4190-b027-5bb77febf1e7 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:33.404856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:33.405452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:33.405729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:33.406001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:33.407570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:33.493016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:33.517968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:33.519411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba56e2-baa8-4e38-a4bd-c820ec589b51 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:33.539363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 677/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:36.300215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74b336-d061-48b4-9cb1-3017e6b6275a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:36.300762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74b336-d061-48b4-9cb1-3017e6b6275a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:36.300762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74b336-d061-48b4-9cb1-3017e6b6275a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:36.302592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 661/1338] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:36.307730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2b15-7e98-458c-a3a9-4d41f2716c35 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:36.308209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2b15-7e98-458c-a3a9-4d41f2716c35 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:36.308344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2b15-7e98-458c-a3a9-4d41f2716c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:36.372635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0c8e2b15-7e98-458c-a3a9-4d41f2716c35 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:36.373845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0c8e2b15-7e98-458c-a3a9-4d41f2716c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:36.468403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 678/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:36.753701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74b336-d061-48b4-9cb1-3017e6b6275a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:36.755261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0b74b336-d061-48b4-9cb1-3017e6b6275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:36.830190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:36.857425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74b336-d061-48b4-9cb1-3017e6b6275a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:36.933775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:36.934382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:36.934656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:36.934924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:36.936521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:37.048733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:37.050205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9830a-0038-4b11-aa07-712872f33cd3 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:37.068402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 662/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:41.374097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059cc66-f44d-439f-ad06-92adbd18b5de None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:41.374652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059cc66-f44d-439f-ad06-92adbd18b5de None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:41.374652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059cc66-f44d-439f-ad06-92adbd18b5de None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:41.376347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 679/1341] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:41.382826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edd2ec-0b79-451d-b39c-70f6a9682605 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:41.382826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edd2ec-0b79-451d-b39c-70f6a9682605 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:41.383365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edd2ec-0b79-451d-b39c-70f6a9682605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:41.389249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:41.462319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-58edd2ec-0b79-451d-b39c-70f6a9682605 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:41.463575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-58edd2ec-0b79-451d-b39c-70f6a9682605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:41.582081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 663/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:41.878400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059cc66-f44d-439f-ad06-92adbd18b5de None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:41.879940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a059cc66-f44d-439f-ad06-92adbd18b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:41.934901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:41.991485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059cc66-f44d-439f-ad06-92adbd18b5de None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:42.066932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:42.067534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:42.067806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:42.068073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:42.070244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:42.163004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:42.178684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:42.180202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dccdd-47d5-4593-8d15-66fb23ef1ca1 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:42.198939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 680/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:45.386786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940469-36f1-421b-859d-a15f840bd386 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:45.387313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940469-36f1-421b-859d-a15f840bd386 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:45.387313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940469-36f1-421b-859d-a15f840bd386 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:45.388693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 664/1344] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:45.394322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a8949-3eb9-4f85-805c-8bd4f8ba9c1d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:45.394793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a8949-3eb9-4f85-805c-8bd4f8ba9c1d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:45.394889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a8949-3eb9-4f85-805c-8bd4f8ba9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:45.464880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-418a8949-3eb9-4f85-805c-8bd4f8ba9c1d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:45.466088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-418a8949-3eb9-4f85-805c-8bd4f8ba9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:45.574929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 681/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:45.856495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60940469-36f1-421b-859d-a15f840bd386 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:45.858025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-60940469-36f1-421b-859d-a15f840bd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:45.950788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:45.968086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60940469-36f1-421b-859d-a15f840bd386 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:46.045963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:46.046566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:46.046865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:46.047132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:46.048728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:46.187307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:46.188840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871db0-114d-4700-9a32-4d0efcc5cc64 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:46.209125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 665/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:50.683105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60ca6-d2f2-44f2-af6d-f555a3694fcc None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:50.683581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60ca6-d2f2-44f2-af6d-f555a3694fcc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:50.683686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60ca6-d2f2-44f2-af6d-f555a3694fcc None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:50.685034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 682/1347] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:50.690636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686e08-f556-448a-bb8f-a0301f18b51d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:50.691106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686e08-f556-448a-bb8f-a0301f18b51d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:50.691265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686e08-f556-448a-bb8f-a0301f18b51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:50.710065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:50.767503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d7686e08-f556-448a-bb8f-a0301f18b51d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:50.769723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d7686e08-f556-448a-bb8f-a0301f18b51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:50.904006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 666/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:57:51.196459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb60ca6-d2f2-44f2-af6d-f555a3694fcc None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:57:51.199043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2fb60ca6-d2f2-44f2-af6d-f555a3694fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:51.260211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:51.307421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb60ca6-d2f2-44f2-af6d-f555a3694fcc None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:57:51.384418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:57:51.385025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:51.385307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:51.385573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:51.387161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:51.491403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:57:51.494844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:57:51.496246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f672-1315-4514-a9ab-d938ec110c9b service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:57:51.514659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 683/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:57:56.448335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443e95-0dda-4af5-843a-f1ab6c2492e9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:56.448756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443e95-0dda-4af5-843a-f1ab6c2492e9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:56.449108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443e95-0dda-4af5-843a-f1ab6c2492e9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:56.450794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 667/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 10:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:57:56.455963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786988-4571-40ca-96c1-645f478436c1 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:57:56.456806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786988-4571-40ca-96c1-645f478436c1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:57:56.457266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d786988-4571-40ca-96c1-645f478436c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:57:56.562575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1d786988-4571-40ca-96c1-645f478436c1 None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:57:56.563897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1d786988-4571-40ca-96c1-645f478436c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:57:56.716012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 684/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:00.892806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b630a-6424-4051-b2d1-906f298bb35d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:00.893357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b630a-6424-4051-b2d1-906f298bb35d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:00.893357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b630a-6424-4051-b2d1-906f298bb35d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:00.894921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 668/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:00.900231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323760d6-e89c-405b-871b-4d178b453bce None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:00.900773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323760d6-e89c-405b-871b-4d178b453bce None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:00.901034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323760d6-e89c-405b-871b-4d178b453bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:00.901991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=59 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:00.967804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:00.992009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-323760d6-e89c-405b-871b-4d178b453bce None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:00.993378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-323760d6-e89c-405b-871b-4d178b453bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:01.110893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 685/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:02.554670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1be946-d772-4958-a34f-7b735eaa5752 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:02.555251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1be946-d772-4958-a34f-7b735eaa5752 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:02.555251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1be946-d772-4958-a34f-7b735eaa5752 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:02.556585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 669/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 10:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:02.561579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d3e7-351a-4b50-b7db-7aba5e7e3fd2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:02.561996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d3e7-351a-4b50-b7db-7aba5e7e3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:02.562133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d3e7-351a-4b50-b7db-7aba5e7e3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:02.653542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-bd97d3e7-351a-4b50-b7db-7aba5e7e3fd2 None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:02.655484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bd97d3e7-351a-4b50-b7db-7aba5e7e3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:02.705285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:02.774655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 686/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:06.484227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c0b9-5e16-4d01-829e-c0f840c95391 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:06.484818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c0b9-5e16-4d01-829e-c0f840c95391 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:06.484818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c0b9-5e16-4d01-829e-c0f840c95391 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:06.486134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 670/1356] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:06.491798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae1cb-22a2-43b5-a80e-4880e63205a9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:06.492243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae1cb-22a2-43b5-a80e-4880e63205a9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:06.492356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ae1cb-22a2-43b5-a80e-4880e63205a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:06.560825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-288ae1cb-22a2-43b5-a80e-4880e63205a9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:06.561926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-288ae1cb-22a2-43b5-a80e-4880e63205a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:06.690993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 687/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:07.003516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd795c-fff4-4d61-9736-1d7769d89987 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:07.004521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd795c-fff4-4d61-9736-1d7769d89987 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:07.004905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd795c-fff4-4d61-9736-1d7769d89987 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:07.006944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 671/1358] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 15 10:58:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:07.018821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38726944-fef4-4f3b-a3cd-787619f3240b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:07.019682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38726944-fef4-4f3b-a3cd-787619f3240b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:07.020283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38726944-fef4-4f3b-a3cd-787619f3240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:07.047645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:07.112477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-38726944-fef4-4f3b-a3cd-787619f3240b None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:07.113670 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-38726944-fef4-4f3b-a3cd-787619f3240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:07.245175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 688/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 15 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:07.253768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd795c-fff4-4d61-9736-1d7769d89987 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:07.255499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7efd795c-fff4-4d61-9736-1d7769d89987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:07.415881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd795c-fff4-4d61-9736-1d7769d89987 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:07.498507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:07.544578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:07.545575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:07.546238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:07.546917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:07.548990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:07.652664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:07.654271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f532ab-303c-43c7-aa81-c80ddff35d42 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:07.673572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 672/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 10:58:10.089608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc075c-6bea-4ec9-a50d-757222eddd48 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:10.090207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc075c-6bea-4ec9-a50d-757222eddd48 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:10.090207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc075c-6bea-4ec9-a50d-757222eddd48 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:10.091622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 689/1361] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:10.096707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a747e4-f27f-42cb-9b47-55028ba3c609 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:10.097169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a747e4-f27f-42cb-9b47-55028ba3c609 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:10.097346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a747e4-f27f-42cb-9b47-55028ba3c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:10.168546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-62a747e4-f27f-42cb-9b47-55028ba3c609 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:10.169754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-62a747e4-f27f-42cb-9b47-55028ba3c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:10.208039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:10.268859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 673/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:10.560848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc075c-6bea-4ec9-a50d-757222eddd48 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:10.562635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6dcc075c-6bea-4ec9-a50d-757222eddd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:10.643538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:10.746711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc075c-6bea-4ec9-a50d-757222eddd48 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:10.878648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:10.879260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:10.879602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:10.879874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:10.882292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:10.905477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:10.976922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:10.978517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc43a9-9357-44c9-929c-867e478f1523 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:10.997935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 690/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:13.777968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056a47d-f218-4635-a2df-57386d3d2e12 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:13.778554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056a47d-f218-4635-a2df-57386d3d2e12 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:13.778554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056a47d-f218-4635-a2df-57386d3d2e12 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:13.780010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 674/1364] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:13.785097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f95f-32a1-44bb-a427-3ce5ca7b1d00 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:13.785494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f95f-32a1-44bb-a427-3ce5ca7b1d00 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:13.785678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f95f-32a1-44bb-a427-3ce5ca7b1d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:13.859614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9467f95f-32a1-44bb-a427-3ce5ca7b1d00 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:13.860870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9467f95f-32a1-44bb-a427-3ce5ca7b1d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:13.965916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:13.972603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 691/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:14.264072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7477f-7a42-4ca7-99ff-8904fa51f3a7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:14.264465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7477f-7a42-4ca7-99ff-8904fa51f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:14.264871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7477f-7a42-4ca7-99ff-8904fa51f3a7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:14.266501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 675/1366] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 15 10:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:14.272738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe7ebb-f69c-4b86-af54-639d848f29e7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:14.273033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe7ebb-f69c-4b86-af54-639d848f29e7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:14.274672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe7ebb-f69c-4b86-af54-639d848f29e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:14.362244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b7fe7ebb-f69c-4b86-af54-639d848f29e7 None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:14.363476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b7fe7ebb-f69c-4b86-af54-639d848f29e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:14.499476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 692/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 15 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:14.504207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7477f-7a42-4ca7-99ff-8904fa51f3a7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:14.506733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8ec7477f-7a42-4ca7-99ff-8904fa51f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:14.672111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7477f-7a42-4ca7-99ff-8904fa51f3a7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:14.699022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65018-333a-44a4-a2c1-9ce3134cc2f8 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:14.699630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65018-333a-44a4-a2c1-9ce3134cc2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:14.700050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e65018-333a-44a4-a2c1-9ce3134cc2f8 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:14.703272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 693/1368] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:58:14.706119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:14.712890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b135-8d34-4a0d-8245-38ca39262559 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:14.713217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b135-8d34-4a0d-8245-38ca39262559 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:14.713436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b135-8d34-4a0d-8245-38ca39262559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:14.795387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:14.804328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2b90b135-8d34-4a0d-8245-38ca39262559 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:14.805603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2b90b135-8d34-4a0d-8245-38ca39262559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:14.833063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:14.834323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:14.834774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:14.835044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:14.837167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:14.927791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 694/1369] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:14.937274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:14.938899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd145da-f471-4ed5-bf09-7710fe1da543 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:14.960108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 676/1370] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:15.272078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece00ed-f66a-48b4-a96d-e2fa7e7d15a6 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:15.272078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece00ed-f66a-48b4-a96d-e2fa7e7d15a6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:15.272078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece00ed-f66a-48b4-a96d-e2fa7e7d15a6 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:15.272078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 695/1371] 10.222.0.26 () {54 vars in 964 bytes} [Thu Sep 15 10:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:15.274108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51e41-9f6b-40d6-8b9d-f1760867eef4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:15.274398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51e41-9f6b-40d6-8b9d-f1760867eef4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:15.274676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a51e41-9f6b-40d6-8b9d-f1760867eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:15.312462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:15.385082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-77a51e41-9f6b-40d6-8b9d-f1760867eef4 None None] MFA Rules not processed for user `e538cfa7711a4ebf8868138f8520018a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:15.386482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77a51e41-9f6b-40d6-8b9d-f1760867eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:15.473781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 677/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Sep 15 10:58:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:15.481662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece00ed-f66a-48b4-a96d-e2fa7e7d15a6 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:15.483181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2ece00ed-f66a-48b4-a96d-e2fa7e7d15a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:15.604411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece00ed-f66a-48b4-a96d-e2fa7e7d15a6 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:15.634648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:15.685295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:15.686902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:15.686902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:15.686902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:15.689016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:15.825465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:15.826729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033f0c5-1c80-4898-9460-54a8bcdcf1ad service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:15.846210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 696/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:17.419702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1157f-2229-4575-92fe-436e059646fe None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:17.420323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1157f-2229-4575-92fe-436e059646fe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:17.420323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1157f-2229-4575-92fe-436e059646fe None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:17.421625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 678/1374] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:17.427716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee919-f386-460e-8d0b-cda7a1d69bda None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:17.428195 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee919-f386-460e-8d0b-cda7a1d69bda None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:17.428292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ee919-f386-460e-8d0b-cda7a1d69bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:17.509214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-238ee919-f386-460e-8d0b-cda7a1d69bda None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:17.510352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-238ee919-f386-460e-8d0b-cda7a1d69bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:17.517923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:17.618167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 697/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:17.917770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1157f-2229-4575-92fe-436e059646fe None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:17.919313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-20e1157f-2229-4575-92fe-436e059646fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:18.035930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:18.073331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1157f-2229-4575-92fe-436e059646fe None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:18.196244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:18.196938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:18.197216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:18.197488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:18.199084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:18.289758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:18.304411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:18.306230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84bca7-c8ee-4801-b526-31423d954aa5 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:18.326418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 679/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:20.722067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232dd7-b7d3-4b02-946e-89620f10a76d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:20.722658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232dd7-b7d3-4b02-946e-89620f10a76d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:20.722658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232dd7-b7d3-4b02-946e-89620f10a76d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:20.725035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 698/1377] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:20.730398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c3f5-4b24-4271-88a7-4d2f0a2f4e4e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:20.730825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c3f5-4b24-4271-88a7-4d2f0a2f4e4e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:20.731035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c3f5-4b24-4271-88a7-4d2f0a2f4e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:20.800567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-64e7c3f5-4b24-4271-88a7-4d2f0a2f4e4e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:20.801826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-64e7c3f5-4b24-4271-88a7-4d2f0a2f4e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:20.902108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 680/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:21.196681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232dd7-b7d3-4b02-946e-89620f10a76d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:21.198320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1c232dd7-b7d3-4b02-946e-89620f10a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:21.340095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:21.351075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232dd7-b7d3-4b02-946e-89620f10a76d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:21.498192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:21.498717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:21.499005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:21.499266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:21.500858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:21.612876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:21.615106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f47af1-b79d-4848-89cb-0f936d37fdd0 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:21.627220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:21.636951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 699/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:24.175098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2448-7ba8-4d5f-995a-ddee00af47df None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:24.175684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2448-7ba8-4d5f-995a-ddee00af47df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:24.175684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2448-7ba8-4d5f-995a-ddee00af47df None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:24.177715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 681/1380] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:24.183574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4fc3a-8f3b-4b0d-980e-6227b2e3af58 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:24.184027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4fc3a-8f3b-4b0d-980e-6227b2e3af58 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:24.184358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4fc3a-8f3b-4b0d-980e-6227b2e3af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:24.272470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d2c4fc3a-8f3b-4b0d-980e-6227b2e3af58 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:24.274344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d2c4fc3a-8f3b-4b0d-980e-6227b2e3af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:24.388730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 700/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:24.763317 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2448-7ba8-4d5f-995a-ddee00af47df None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:24.764872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-065f2448-7ba8-4d5f-995a-ddee00af47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:24.829198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:24.917655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2448-7ba8-4d5f-995a-ddee00af47df None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:25.037154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:25.037774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:25.038056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:25.038332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:25.039951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:25.059989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:25.136131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:25.137771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eb572-c6c1-495a-9484-595b546427bd service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:25.155787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 682/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:27.484871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484c9d-5b9e-48d4-aba2-f37f215fce77 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:27.485433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484c9d-5b9e-48d4-aba2-f37f215fce77 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:27.485433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484c9d-5b9e-48d4-aba2-f37f215fce77 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:27.486907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 701/1383] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:27.493177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3eb85-1e26-45e8-8192-b9a80047b5da None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:27.493633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3eb85-1e26-45e8-8192-b9a80047b5da None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:27.493753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3eb85-1e26-45e8-8192-b9a80047b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:27.565398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-97a3eb85-1e26-45e8-8192-b9a80047b5da None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:27.566597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-97a3eb85-1e26-45e8-8192-b9a80047b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:27.683025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:27.690385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 683/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:28.074766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484c9d-5b9e-48d4-aba2-f37f215fce77 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:28.076299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6a484c9d-5b9e-48d4-aba2-f37f215fce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:28.173187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:28.268113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484c9d-5b9e-48d4-aba2-f37f215fce77 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:28.422218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:28.422818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:28.423092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:28.423364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:28.424965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:28.469137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:28.523613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:28.525298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd757125-f49a-4560-88af-5ba2ba98784d service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:28.544867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 702/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:30.737992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0027-f0d9-412d-bd9b-6ccfbab7e234 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:30.737992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0027-f0d9-412d-bd9b-6ccfbab7e234 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:30.737992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0027-f0d9-412d-bd9b-6ccfbab7e234 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:30.741644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 684/1386] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:30.745960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003366b-613a-4dcb-9824-f07e1968fc88 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:30.746420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003366b-613a-4dcb-9824-f07e1968fc88 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:30.746507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003366b-613a-4dcb-9824-f07e1968fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:30.820051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3003366b-613a-4dcb-9824-f07e1968fc88 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:30.821332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3003366b-613a-4dcb-9824-f07e1968fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:30.922380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 703/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:31.216428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b0027-f0d9-412d-bd9b-6ccfbab7e234 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:31.217937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-976b0027-f0d9-412d-bd9b-6ccfbab7e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:31.362511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b0027-f0d9-412d-bd9b-6ccfbab7e234 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:31.436071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:31.483324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:31.483855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:31.484137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:31.484503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:31.486125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:31.488933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dce4b-5df5-4a61-b272-329f42e5f9e7 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:31.489227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dce4b-5df5-4a61-b272-329f42e5f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:31.489615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dce4b-5df5-4a61-b272-329f42e5f9e7 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:31.491218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 704/1388] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:31.496731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabcaa8-63ab-410f-9a54-af3e69d57ac6 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:31.497083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabcaa8-63ab-410f-9a54-af3e69d57ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:31.497428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabcaa8-63ab-410f-9a54-af3e69d57ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:31.514488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:31.565863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-acabcaa8-63ab-410f-9a54-af3e69d57ac6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:31.567622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-acabcaa8-63ab-410f-9a54-af3e69d57ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:31.579719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:31.581359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecd7b-bfc9-4578-b2fa-ae44d6d72824 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:31.599723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 685/1389] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:31.671998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 705/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:31.991601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317b58-1413-49bb-91a6-c0d38b0c9eb4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:31.992094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317b58-1413-49bb-91a6-c0d38b0c9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:31.992201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317b58-1413-49bb-91a6-c0d38b0c9eb4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:31.993524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 686/1391] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 15 10:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:31.998927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c50420-59ce-417d-8451-277cca30f031 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:31.999344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c50420-59ce-417d-8451-277cca30f031 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:31.999617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c50420-59ce-417d-8451-277cca30f031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:32.078322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-79c50420-59ce-417d-8451-277cca30f031 None None] MFA Rules not processed for user `1d237fc491984323aa81865c59d71771`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:32.079512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-79c50420-59ce-417d-8451-277cca30f031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:32.115073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:32.157690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 706/1392] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 15 10:58:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:32.167328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317b58-1413-49bb-91a6-c0d38b0c9eb4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:32.168951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-66317b58-1413-49bb-91a6-c0d38b0c9eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:32.252032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:32.274500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317b58-1413-49bb-91a6-c0d38b0c9eb4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:32.351175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:32.352107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:32.352636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:32.353452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:32.354928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:32.468330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:32.469770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d8831-e622-4e05-9f20-1c962aabdf29 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:32.488009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 687/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:33.398521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488396f-7bca-45f1-a569-e57603e1537b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:33.399010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488396f-7bca-45f1-a569-e57603e1537b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:33.399104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488396f-7bca-45f1-a569-e57603e1537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:33.465933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d488396f-7bca-45f1-a569-e57603e1537b None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:33.467121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d488396f-7bca-45f1-a569-e57603e1537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:33.554805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 707/1394] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:33.601933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093f77-fd5d-4b1a-929c-aa3767533cb3 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:33.602418 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093f77-fd5d-4b1a-929c-aa3767533cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:33.602535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093f77-fd5d-4b1a-929c-aa3767533cb3 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:33.603824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 688/1395] 10.222.0.26 () {54 vars in 943 bytes} [Thu Sep 15 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:33.610254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186c19-36c0-4314-9349-22226985003b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:33.610637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186c19-36c0-4314-9349-22226985003b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:33.610921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c186c19-36c0-4314-9349-22226985003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:33.670262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:33.689940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5c186c19-36c0-4314-9349-22226985003b None None] MFA Rules not processed for user `8107c052569f41c3a0d7f188d1642f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:33.691125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5c186c19-36c0-4314-9349-22226985003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:33.799919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 708/1396] 10.222.0.26 () {58 vars in 1040 bytes} [Thu Sep 15 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:33.809947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093f77-fd5d-4b1a-929c-aa3767533cb3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:33.811477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d5093f77-fd5d-4b1a-929c-aa3767533cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:33.825075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:33.958159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd943f7-5ad9-4730-8598-ec44bba00ec5 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:33.958432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd943f7-5ad9-4730-8598-ec44bba00ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:33.958707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd943f7-5ad9-4730-8598-ec44bba00ec5 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:33.960243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 709/1397] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:58:33.961936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093f77-fd5d-4b1a-929c-aa3767533cb3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:33.965431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:33.965716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:33.965988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:34.042782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:34.043979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:34.072555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:34.077427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ff434-3108-4038-8012-66532a11749b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:34.078091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ff434-3108-4038-8012-66532a11749b service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:34.078548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ff434-3108-4038-8012-66532a11749b service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:34.078666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ff434-3108-4038-8012-66532a11749b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:34.080187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-288ff434-3108-4038-8012-66532a11749b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:34.102534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:34.145647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 710/1398] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:58:34.172022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ff434-3108-4038-8012-66532a11749b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:34.173680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ff434-3108-4038-8012-66532a11749b service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:34.182046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 689/1399] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 10:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 10:58:34.437087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:34.438290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:34.578606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a988472-7847-4503-9e9d-78afdc0e13a2 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:34.654921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:34.702972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:34.703578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:34.703855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:34.704124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:34.705739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:34.811286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:34.813108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e0f6-a256-4f69-ae9e-8e0238ef059a service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:34.834857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 711/1400] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:37.902479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b793-8af9-4209-8299-16dbbbdddb21 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:37.903138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b793-8af9-4209-8299-16dbbbdddb21 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:37.903424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b793-8af9-4209-8299-16dbbbdddb21 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:37.905037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 690/1401] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:37.911386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b0365-02bf-4c97-b468-755c9983709b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:37.911949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b0365-02bf-4c97-b468-755c9983709b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:37.912068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b0365-02bf-4c97-b468-755c9983709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:37.992040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-416b0365-02bf-4c97-b468-755c9983709b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:37.993296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-416b0365-02bf-4c97-b468-755c9983709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:38.029142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:38.108356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 712/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:38.405900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b793-8af9-4209-8299-16dbbbdddb21 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:38.411661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-da90b793-8af9-4209-8299-16dbbbdddb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:38.570829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:38.581318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b793-8af9-4209-8299-16dbbbdddb21 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:38.715191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:38.715803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:38.716165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:38.716503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:38.718114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:38.821142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:38.823077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4aade-678f-49e6-a82e-0b724efd904b service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:38.834445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:38.843720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 691/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:41.275570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8e2e-418a-47b7-8408-6bf1663cb732 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:41.276144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8e2e-418a-47b7-8408-6bf1663cb732 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:41.276144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8e2e-418a-47b7-8408-6bf1663cb732 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:41.277619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 713/1404] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:41.282640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7cab-8f3c-45d7-add9-0cc22425ed51 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:41.283054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7cab-8f3c-45d7-add9-0cc22425ed51 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:41.283241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7cab-8f3c-45d7-add9-0cc22425ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:41.352761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-74ac7cab-8f3c-45d7-add9-0cc22425ed51 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:41.353904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-74ac7cab-8f3c-45d7-add9-0cc22425ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:41.460288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 692/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:41.759517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a8e2e-418a-47b7-8408-6bf1663cb732 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:41.761368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4b0a8e2e-418a-47b7-8408-6bf1663cb732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:41.924980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a8e2e-418a-47b7-8408-6bf1663cb732 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:41.944456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:42.071454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:42.072384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:42.072833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:42.073273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:42.075052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:42.177830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:42.179628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470aa265-d3c6-4eb7-934e-e3cccf362da1 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:42.198656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 714/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:44.586622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef87b5-d8b7-479c-9eab-bbafdeba620e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:44.587219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef87b5-d8b7-479c-9eab-bbafdeba620e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:44.587219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef87b5-d8b7-479c-9eab-bbafdeba620e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:44.592482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 693/1407] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 10:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:44.593979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8480-c994-44d4-8e6c-b5f0dcdc5ea3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:44.594883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8480-c994-44d4-8e6c-b5f0dcdc5ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:44.595162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8480-c994-44d4-8e6c-b5f0dcdc5ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:44.627797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:44.670763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3ded8480-c994-44d4-8e6c-b5f0dcdc5ea3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:44.671963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3ded8480-c994-44d4-8e6c-b5f0dcdc5ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:44.786518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 715/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:45.075310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef87b5-d8b7-479c-9eab-bbafdeba620e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:58:45.076851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cdef87b5-d8b7-479c-9eab-bbafdeba620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:45.169560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:45.251465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef87b5-d8b7-479c-9eab-bbafdeba620e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:58:45.394091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:58:45.395521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:45.395934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:45.396368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:45.398448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:45.450290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:45.508193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:58:45.509958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92d806-5a7f-4eb8-8d3f-478ef086a9d2 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:58:45.531828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 694/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:58:54.782152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=56 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:55.529484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=29 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:57.889805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1609125-785b-48b3-9cb8-6ef8bf9606f0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:57.890384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1609125-785b-48b3-9cb8-6ef8bf9606f0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:57.890384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1609125-785b-48b3-9cb8-6ef8bf9606f0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:57.891710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 716/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu Sep 15 10:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:57.897093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613047e-70aa-49c0-8e9b-a139e88c2bce None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:57.897521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613047e-70aa-49c0-8e9b-a139e88c2bce None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:57.897639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613047e-70aa-49c0-8e9b-a139e88c2bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:57.973014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e613047e-70aa-49c0-8e9b-a139e88c2bce None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:57.974221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e613047e-70aa-49c0-8e9b-a139e88c2bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:58.080685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 695/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Sep 15 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:58:58.095603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a352e04-ac88-4741-b5cc-a46a8da5d347 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:58.095889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a352e04-ac88-4741-b5cc-a46a8da5d347 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:58.096171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a352e04-ac88-4741-b5cc-a46a8da5d347 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:58.098061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 717/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu Sep 15 10:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:58:58.103020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564be2c-de83-4324-bf91-439fc13efc4b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:58:58.103312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564be2c-de83-4324-bf91-439fc13efc4b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:58:58.103592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564be2c-de83-4324-bf91-439fc13efc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:58:58.180430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:58:58.183362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a564be2c-de83-4324-bf91-439fc13efc4b None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:58:58.184604 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a564be2c-de83-4324-bf91-439fc13efc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:58:58.302125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 696/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Sep 15 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:00.868654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c22fd4-7101-4149-90e7-f20760ee672e None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:00.869228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c22fd4-7101-4149-90e7-f20760ee672e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:00.869228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c22fd4-7101-4149-90e7-f20760ee672e None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:00.870535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:00.875802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db3a6-6b2a-4734-b524-55c6d73e7bda None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:00.876227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db3a6-6b2a-4734-b524-55c6d73e7bda None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:00.876363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db3a6-6b2a-4734-b524-55c6d73e7bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:00.942971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8a2db3a6-6b2a-4734-b524-55c6d73e7bda None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:00.944147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8a2db3a6-6b2a-4734-b524-55c6d73e7bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:00.998413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:01.052040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:01.352338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c22fd4-7101-4149-90e7-f20760ee672e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:01.354178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f7c22fd4-7101-4149-90e7-f20760ee672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:01.499182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c22fd4-7101-4149-90e7-f20760ee672e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:01.573095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:01.613562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:01.614174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:01.614454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:01.614726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:01.616640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:01.714885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:01.716512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21092070-0008-41f7-a734-d95b21b64023 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:01.733808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 719/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:02.887212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19550e62-7396-42b7-9b00-30e3832b566c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:02.887768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19550e62-7396-42b7-9b00-30e3832b566c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:02.887768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19550e62-7396-42b7-9b00-30e3832b566c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:02.889166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:02.896133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112df9b-0022-4da4-b232-88ecfb9d3371 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:02.896642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112df9b-0022-4da4-b232-88ecfb9d3371 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:02.896747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112df9b-0022-4da4-b232-88ecfb9d3371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:02.974171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1112df9b-0022-4da4-b232-88ecfb9d3371 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:02.975376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1112df9b-0022-4da4-b232-88ecfb9d3371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:03.005258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:03.079499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:59:03.232578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19550e62-7396-42b7-9b00-30e3832b566c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:03.234004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-19550e62-7396-42b7-9b00-30e3832b566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:03.379196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19550e62-7396-42b7-9b00-30e3832b566c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:03.419004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:03.489719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:03.490504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:03.490786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:03.491063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:03.492688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:03.580472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:03.582672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831ec27-b343-4f82-ab54-1bccc0a8fd6b service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:03.600139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 699/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:04.746976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9560b-891f-4d16-b1ee-aea6f23055ff None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:04.747541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9560b-891f-4d16-b1ee-aea6f23055ff None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:04.747541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9560b-891f-4d16-b1ee-aea6f23055ff None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:04.748898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:04.755232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8b01-4c6d-4e3a-97f3-77293381fb46 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:04.755646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8b01-4c6d-4e3a-97f3-77293381fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:04.755797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8b01-4c6d-4e3a-97f3-77293381fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:04.808881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:04.829666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-703c8b01-4c6d-4e3a-97f3-77293381fb46 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:04.830859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-703c8b01-4c6d-4e3a-97f3-77293381fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:04.928247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:05.078998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9560b-891f-4d16-b1ee-aea6f23055ff None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:05.080547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-71b9560b-891f-4d16-b1ee-aea6f23055ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:05.227993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9560b-891f-4d16-b1ee-aea6f23055ff None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:05.240811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:05.343719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:05.344345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:05.344627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:05.344898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:05.346488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:05.446930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:05.448560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72df23-0a21-4eda-a8a4-3e7d7778f9dc service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:05.466748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 722/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:06.608232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef2e7-563c-47ef-afeb-98e401db2ea2 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:06.608695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef2e7-563c-47ef-afeb-98e401db2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:06.609030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef2e7-563c-47ef-afeb-98e401db2ea2 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:06.610133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:06.618031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa60ca1-495f-4050-b3ae-4ede40f1c873 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:06.618572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa60ca1-495f-4050-b3ae-4ede40f1c873 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:06.618572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa60ca1-495f-4050-b3ae-4ede40f1c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:06.639016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:06.694463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-baa60ca1-495f-4050-b3ae-4ede40f1c873 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:06.695680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-baa60ca1-495f-4050-b3ae-4ede40f1c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:06.792294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:59:06.943579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef2e7-563c-47ef-afeb-98e401db2ea2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:06.945154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-421ef2e7-563c-47ef-afeb-98e401db2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:07.056500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:07.092284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef2e7-563c-47ef-afeb-98e401db2ea2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:07.203548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:07.204071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:07.204378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:07.204662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:07.207058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:07.283872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:07.297637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:07.299248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d7cb-21e2-4761-b94f-2ca1408acd7e service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:07.317425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 702/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:08.529909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafefe-4114-4a53-b901-f8d99fff14ba None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:08.530513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafefe-4114-4a53-b901-f8d99fff14ba None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:08.530513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafefe-4114-4a53-b901-f8d99fff14ba None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:08.531829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:08.538664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7475b2-b62d-4966-a228-8e67c2db593e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:08.539112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7475b2-b62d-4966-a228-8e67c2db593e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:08.539224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7475b2-b62d-4966-a228-8e67c2db593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:08.618937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2b7475b2-b62d-4966-a228-8e67c2db593e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:08.620147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b7475b2-b62d-4966-a228-8e67c2db593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:08.717028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:08.872871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafefe-4114-4a53-b901-f8d99fff14ba None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:08.874371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bbfafefe-4114-4a53-b901-f8d99fff14ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:08.957363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:09.018158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafefe-4114-4a53-b901-f8d99fff14ba None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:09.131842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:09.132392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:09.132669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:09.132937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:09.134507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:09.182784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:09.226132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:09.227713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114a60d-bda6-4955-80d7-d68523a6f6ce service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:09.246520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 725/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:10.372145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f3fd-19a5-4f9e-9956-93ceefef536d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:10.372726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f3fd-19a5-4f9e-9956-93ceefef536d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:10.372726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33f3fd-19a5-4f9e-9956-93ceefef536d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:10.374082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:10.380838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c046-d13b-4da5-9a16-b49679931c9b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:10.381279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c046-d13b-4da5-9a16-b49679931c9b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:10.381375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c046-d13b-4da5-9a16-b49679931c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:10.457237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0c68c046-d13b-4da5-9a16-b49679931c9b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:10.458439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0c68c046-d13b-4da5-9a16-b49679931c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:10.553601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:10.704609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f3fd-19a5-4f9e-9956-93ceefef536d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:10.706727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f33f3fd-19a5-4f9e-9956-93ceefef536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:10.757642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:10.857025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33f3fd-19a5-4f9e-9956-93ceefef536d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:10.968801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:10.969316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:10.969595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:10.969867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:10.971513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:10.978411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:11.062003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:11.063608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a9009-b59e-44f6-adb7-7a8042cac8d4 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:11.081720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 705/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:12.201750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147f67-4bfb-4179-8ea2-346995fd3058 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:12.202340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147f67-4bfb-4179-8ea2-346995fd3058 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:12.202340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147f67-4bfb-4179-8ea2-346995fd3058 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:12.203622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:12.209882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dcfd1-d3fe-437a-b15b-bad3439466fc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:12.210304 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dcfd1-d3fe-437a-b15b-bad3439466fc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:12.210459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dcfd1-d3fe-437a-b15b-bad3439466fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:12.293457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4e1dcfd1-d3fe-437a-b15b-bad3439466fc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:12.294546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e1dcfd1-d3fe-437a-b15b-bad3439466fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:12.362096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:12.390537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:12.548284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147f67-4bfb-4179-8ea2-346995fd3058 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:12.550655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-03147f67-4bfb-4179-8ea2-346995fd3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:12.568845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:12.695300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147f67-4bfb-4179-8ea2-346995fd3058 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:12.780613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:12.806807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:12.807345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:12.807619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:12.807889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:12.809511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:12.905836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:12.907453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e15e28-9f21-4b6a-822d-e283a458b3f3 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:12.926130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 728/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:14.066519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e430875-b618-437a-b464-829bafe2ebb4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:14.067039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e430875-b618-437a-b464-829bafe2ebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:14.067039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e430875-b618-437a-b464-829bafe2ebb4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:14.068438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 10:59:14.074558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4806c-f371-4eb0-89f4-ae33341adfa8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:14.075005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4806c-f371-4eb0-89f4-ae33341adfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:14.075115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4806c-f371-4eb0-89f4-ae33341adfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:14.151824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-92c4806c-f371-4eb0-89f4-ae33341adfa8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:14.153058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-92c4806c-f371-4eb0-89f4-ae33341adfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:14.193695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:14.246746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:14.401790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e430875-b618-437a-b464-829bafe2ebb4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:14.403326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7e430875-b618-437a-b464-829bafe2ebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:14.552270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e430875-b618-437a-b464-829bafe2ebb4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:14.606625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:14.666577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:14.667095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:14.667369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:14.667636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:14.669235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:14.757678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:14.759270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b6f57-4465-4a22-a901-d5b822226e4b service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:14.776811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 708/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:15.896580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f94e-b8fd-410c-8205-d1d936d8a09b None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:15.897125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f94e-b8fd-410c-8205-d1d936d8a09b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:15.897125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f94e-b8fd-410c-8205-d1d936d8a09b None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:15.898478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 10:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:15.904771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f72a-362c-4aee-8e87-56c078c89640 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:15.905185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f72a-362c-4aee-8e87-56c078c89640 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:15.905290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f72a-362c-4aee-8e87-56c078c89640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:15.979674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8756f72a-362c-4aee-8e87-56c078c89640 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:15.980883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8756f72a-362c-4aee-8e87-56c078c89640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:15.982868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:16.084916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 10:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:16.236365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f94e-b8fd-410c-8205-d1d936d8a09b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:16.238397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-25b5f94e-b8fd-410c-8205-d1d936d8a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:16.386609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f94e-b8fd-410c-8205-d1d936d8a09b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:16.414310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:16.499735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:16.500251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:16.500554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:16.500822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:16.502908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:16.590785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:16.592385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d59d5-e47a-4080-8fbf-ef1e556ccc60 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:16.609954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 731/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:18.677780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d44c9-af9b-4be0-88ec-22178a7f9b87 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:18.678383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d44c9-af9b-4be0-88ec-22178a7f9b87 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:18.678383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d44c9-af9b-4be0-88ec-22178a7f9b87 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:18.679654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:18.685044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2aa55-8cf6-4928-a4de-8c1d4401449b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:18.685491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2aa55-8cf6-4928-a4de-8c1d4401449b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:18.685599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2aa55-8cf6-4928-a4de-8c1d4401449b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:18.727175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:18.752907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a4c2aa55-8cf6-4928-a4de-8c1d4401449b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:18.754151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a4c2aa55-8cf6-4928-a4de-8c1d4401449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:18.850652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:19.133242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d44c9-af9b-4be0-88ec-22178a7f9b87 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:19.134797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-065d44c9-af9b-4be0-88ec-22178a7f9b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:19.238250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d44c9-af9b-4be0-88ec-22178a7f9b87 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:19.270945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:19.311638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:19.312557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:19.312998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:19.313348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:19.315530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:19.423632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:19.425116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208003d5-16e0-46d4-972e-5544f2a7e4e0 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:19.443092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 711/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:21.768174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a08eb-f989-459e-8505-41d5af5f1884 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:21.768794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a08eb-f989-459e-8505-41d5af5f1884 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:21.768794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a08eb-f989-459e-8505-41d5af5f1884 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:21.770106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:21.775481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b60f-73ff-44a8-81a1-997d72439067 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:21.778037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b60f-73ff-44a8-81a1-997d72439067 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:21.778037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b60f-73ff-44a8-81a1-997d72439067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:21.841092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-54d5b60f-73ff-44a8-81a1-997d72439067 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:21.842277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-54d5b60f-73ff-44a8-81a1-997d72439067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:21.855316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:21.938330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:22.224601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a08eb-f989-459e-8505-41d5af5f1884 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:22.226157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-718a08eb-f989-459e-8505-41d5af5f1884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:22.329259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a08eb-f989-459e-8505-41d5af5f1884 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:22.344035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:22.406245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:22.406850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:22.407128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:22.407398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:22.409996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:22.520487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:22.521943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5c508-e8ae-44ec-bee2-89fc7b3a0118 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:22.540135 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 734/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:25.084371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b729-1701-43a8-aad8-4ec97c3b0a90 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:25.084833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b729-1701-43a8-aad8-4ec97c3b0a90 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:25.084954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b729-1701-43a8-aad8-4ec97c3b0a90 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:25.086362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:25.091817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5ee6-f040-4d78-b960-68aa58a6d6e2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:25.101914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5ee6-f040-4d78-b960-68aa58a6d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:25.101914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5ee6-f040-4d78-b960-68aa58a6d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:25.139742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:25.157325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-394f5ee6-f040-4d78-b960-68aa58a6d6e2 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:25.159437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-394f5ee6-f040-4d78-b960-68aa58a6d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:25.254539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:25.540780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b729-1701-43a8-aad8-4ec97c3b0a90 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:25.542323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7a49b729-1701-43a8-aad8-4ec97c3b0a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:25.646423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b729-1701-43a8-aad8-4ec97c3b0a90 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:25.685567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:25.719007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:25.719622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:25.719904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:25.720330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:25.722887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:25.832637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:25.833987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e023ad-9226-46bb-9063-9e3beac8cb49 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:25.851899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 714/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:28.326073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df0f78-61f1-47d1-8c60-d6d1e43f3bc2 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:28.326616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df0f78-61f1-47d1-8c60-d6d1e43f3bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:28.326616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df0f78-61f1-47d1-8c60-d6d1e43f3bc2 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:28.327919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:28.333519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247c8d-6c68-45b4-891b-f0a1ce55e138 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:28.333984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247c8d-6c68-45b4-891b-f0a1ce55e138 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:28.334096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247c8d-6c68-45b4-891b-f0a1ce55e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:28.407884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fa247c8d-6c68-45b4-891b-f0a1ce55e138 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:28.409791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fa247c8d-6c68-45b4-891b-f0a1ce55e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:28.432107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:28.508077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 10:59:28.794440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df0f78-61f1-47d1-8c60-d6d1e43f3bc2 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:28.795978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d1df0f78-61f1-47d1-8c60-d6d1e43f3bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:28.896581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df0f78-61f1-47d1-8c60-d6d1e43f3bc2 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:28.916162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:28.968061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:28.968684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:28.968960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:28.969225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:28.970869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:29.197299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:29.198621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b956717-69b5-4fb3-9b4a-6f7c9ac765e0 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:29.217237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 737/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:31.428461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe235a3-d3ee-418c-a079-d7443946c8fc None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:31.429032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe235a3-d3ee-418c-a079-d7443946c8fc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:31.429032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe235a3-d3ee-418c-a079-d7443946c8fc None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:31.430380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:31.435572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4621-3777-4a48-bf40-9d98d3b577c6 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:31.435966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4621-3777-4a48-bf40-9d98d3b577c6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:31.436102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4621-3777-4a48-bf40-9d98d3b577c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:31.498155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:31.501393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-266f4621-3777-4a48-bf40-9d98d3b577c6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:31.502603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-266f4621-3777-4a48-bf40-9d98d3b577c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:31.594647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:31.886996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe235a3-d3ee-418c-a079-d7443946c8fc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:31.888562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5fe235a3-d3ee-418c-a079-d7443946c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:31.993792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe235a3-d3ee-418c-a079-d7443946c8fc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:32.046084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:32.073823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:32.074438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:32.074913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:32.075377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:32.077283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:32.192033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:32.193503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165393a-1257-43a3-8cfd-a902d573b4a1 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:32.212121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 717/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:34.509661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831121db-8abf-4390-98c1-9b16b5c1772d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:34.510233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831121db-8abf-4390-98c1-9b16b5c1772d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:34.510233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831121db-8abf-4390-98c1-9b16b5c1772d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:34.511533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:34.516827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64919-e18a-4b56-8bd7-7744f4075a8b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:34.517810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64919-e18a-4b56-8bd7-7744f4075a8b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:34.518172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64919-e18a-4b56-8bd7-7744f4075a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:34.583269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d3f64919-e18a-4b56-8bd7-7744f4075a8b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:34.584535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d3f64919-e18a-4b56-8bd7-7744f4075a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:34.612830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:34.682341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:34.967426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831121db-8abf-4390-98c1-9b16b5c1772d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:34.968975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-831121db-8abf-4390-98c1-9b16b5c1772d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:35.072526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831121db-8abf-4390-98c1-9b16b5c1772d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:35.101405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:35.145825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:35.146422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:35.146698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:35.146968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:35.148611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:35.258988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:35.260347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc7dc0-da7e-4b33-b3d6-cf399ed95433 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:35.278179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 740/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:37.515454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e262a-ec31-431b-b205-6c26577db480 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:37.516028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e262a-ec31-431b-b205-6c26577db480 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:37.516028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e262a-ec31-431b-b205-6c26577db480 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:37.518132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:37.523324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd497d-c048-4556-a498-66172424d193 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:37.523715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd497d-c048-4556-a498-66172424d193 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:37.523867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd497d-c048-4556-a498-66172424d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:37.589239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e6bd497d-c048-4556-a498-66172424d193 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:37.590425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e6bd497d-c048-4556-a498-66172424d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:37.598865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:37.684794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:37.977483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e262a-ec31-431b-b205-6c26577db480 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:37.979054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-823e262a-ec31-431b-b205-6c26577db480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:38.085388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e262a-ec31-431b-b205-6c26577db480 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:38.141124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:38.160851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:38.161511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:38.161796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:38.162202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:38.163802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:38.275028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:38.276537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75924044-c7ab-4084-97f4-41c4bc3ee197 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:38.295157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 720/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:40.539302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1cdef-a1bb-4a4a-9179-25540b3d8505 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:40.539872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1cdef-a1bb-4a4a-9179-25540b3d8505 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:40.539872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1cdef-a1bb-4a4a-9179-25540b3d8505 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:40.541228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:40.546411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e49d-048e-4f5d-a779-1dea677ef683 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:40.546831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e49d-048e-4f5d-a779-1dea677ef683 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:40.546962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e49d-048e-4f5d-a779-1dea677ef683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:40.612473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-80d7e49d-048e-4f5d-a779-1dea677ef683 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:40.613662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80d7e49d-048e-4f5d-a779-1dea677ef683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:40.653079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:40.711008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:40.997498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1cdef-a1bb-4a4a-9179-25540b3d8505 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:40.999010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-79b1cdef-a1bb-4a4a-9179-25540b3d8505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:41.100850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1cdef-a1bb-4a4a-9179-25540b3d8505 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:41.138478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:41.174904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:41.175501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:41.175779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:41.176056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:41.177666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:41.284172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:41.285549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63e4d-0ffd-4bec-9d01-4b46f5f0519f service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:41.304489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 743/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:43.455010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d828-fb84-4c58-aa84-7b81d0e034c6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:43.455590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d828-fb84-4c58-aa84-7b81d0e034c6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:43.455590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d828-fb84-4c58-aa84-7b81d0e034c6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:43.456971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:43.462320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f37b-ac51-4518-8609-24b21daec957 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:43.462706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f37b-ac51-4518-8609-24b21daec957 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:43.462856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9f37b-ac51-4518-8609-24b21daec957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:43.526386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1ac9f37b-ac51-4518-8609-24b21daec957 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:43.527558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1ac9f37b-ac51-4518-8609-24b21daec957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:43.545373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:43.621935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:43.901175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899d828-fb84-4c58-aa84-7b81d0e034c6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:43.902709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8899d828-fb84-4c58-aa84-7b81d0e034c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:44.006831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899d828-fb84-4c58-aa84-7b81d0e034c6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:44.075299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:44.082699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:44.083301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:44.083582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:44.083857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:44.085455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:44.196030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:44.197415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b0909-86de-48fe-8206-4c40764e5508 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:44.216518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 723/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:46.401397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd32c-f112-42f2-a735-32b3aaf315a9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:46.401967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd32c-f112-42f2-a735-32b3aaf315a9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:46.401967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bd32c-f112-42f2-a735-32b3aaf315a9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:46.403266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 10:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 10:59:46.408932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134293-31a6-439d-a69b-41d9db9ce80c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:46.409377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134293-31a6-439d-a69b-41d9db9ce80c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:46.409493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134293-31a6-439d-a69b-41d9db9ce80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:46.476049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5d134293-31a6-439d-a69b-41d9db9ce80c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 10:59:46.477414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5d134293-31a6-439d-a69b-41d9db9ce80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:46.526611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:46.575156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 10:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 10:59:46.892564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd32c-f112-42f2-a735-32b3aaf315a9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 10:59:46.894092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-880bd32c-f112-42f2-a735-32b3aaf315a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:46.998370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bd32c-f112-42f2-a735-32b3aaf315a9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 10:59:47.059631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:47.086793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 10:59:47.088175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 10:59:47.089458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 10:59:47.090687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 10:59:47.092642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 10:59:47.200638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 10:59:47.201959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78304-19c4-4c51-adf5-6016a8537a7f service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 10:59:47.220649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 746/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 10:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 10:59:56.573647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=22 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 10:59:57.217500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=66 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:07.588827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408901f3-c4e6-4b7d-a882-fb0c564965ae None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:07.589408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408901f3-c4e6-4b7d-a882-fb0c564965ae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:07.589408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408901f3-c4e6-4b7d-a882-fb0c564965ae None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:07.590730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 725/1471] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:07.596678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635b671-ea3d-4836-99d4-9bf7d70a207c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:07.597117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635b671-ea3d-4836-99d4-9bf7d70a207c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:07.597231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635b671-ea3d-4836-99d4-9bf7d70a207c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:07.663503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-8635b671-ea3d-4836-99d4-9bf7d70a207c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:07.664737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8635b671-ea3d-4836-99d4-9bf7d70a207c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:07.759899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 747/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:08.065616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365be2-f6e2-42dd-a111-0a928cac595f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:08.065933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365be2-f6e2-42dd-a111-0a928cac595f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:08.066210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365be2-f6e2-42dd-a111-0a928cac595f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:08.067591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 726/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 15 11:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:08.072738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1d46-f5f5-440d-a69c-ff9443f12336 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:08.073026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1d46-f5f5-440d-a69c-ff9443f12336 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:08.073302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a1d46-f5f5-440d-a69c-ff9443f12336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:08.149577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-657a1d46-f5f5-440d-a69c-ff9443f12336 None None] MFA Rules not processed for user `1d237fc491984323aa81865c59d71771`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:08.150777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-657a1d46-f5f5-440d-a69c-ff9443f12336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:08.171022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:08.227036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 748/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 15 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:08.234615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365be2-f6e2-42dd-a111-0a928cac595f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:08.238455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-24365be2-f6e2-42dd-a111-0a928cac595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:08.341865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365be2-f6e2-42dd-a111-0a928cac595f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:08.418356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:08.418970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:08.419244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:08.419517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:08.421117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:08.475746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:08.532072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:08.533679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4dd49-2aec-4d3a-a488-d125e6f96b93 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:08.551823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 727/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:00:10.810037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931653-1681-4362-afa3-79f8798a5fc9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:10.810602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931653-1681-4362-afa3-79f8798a5fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:10.810602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931653-1681-4362-afa3-79f8798a5fc9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:10.811907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 749/1476] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:10.817890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f34b8-c4dc-456f-8801-ccded53ce374 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:10.820885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f34b8-c4dc-456f-8801-ccded53ce374 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:10.820885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f34b8-c4dc-456f-8801-ccded53ce374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:10.884813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-be1f34b8-c4dc-456f-8801-ccded53ce374 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:10.886020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be1f34b8-c4dc-456f-8801-ccded53ce374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:10.982875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 728/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:11.258317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931653-1681-4362-afa3-79f8798a5fc9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:11.259787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ac931653-1681-4362-afa3-79f8798a5fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:11.384977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931653-1681-4362-afa3-79f8798a5fc9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:11.434490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:11.477300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:11.477895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:11.478167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:11.478435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:11.479060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:11.480783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:00:11.480783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:00:11.480783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:00:11.481891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1fa0d-d815-4dad-9f10-19c660f4c5f4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:11.501584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 750/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Sep 15 11:00:11 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:00:13.698150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa55f-6216-4746-9b0b-b83be120ec16 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:13.698732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa55f-6216-4746-9b0b-b83be120ec16 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:13.698732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fa55f-6216-4746-9b0b-b83be120ec16 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:13.700060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 729/1479] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:13.705909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8380cf4-ce8d-4a4c-b8e2-45187ae4febe None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:13.706351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8380cf4-ce8d-4a4c-b8e2-45187ae4febe None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:13.709065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8380cf4-ce8d-4a4c-b8e2-45187ae4febe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:13.771993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c8380cf4-ce8d-4a4c-b8e2-45187ae4febe None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:13.773224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c8380cf4-ce8d-4a4c-b8e2-45187ae4febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:13.867144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 751/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:14.160721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fa55f-6216-4746-9b0b-b83be120ec16 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:14.162227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d11fa55f-6216-4746-9b0b-b83be120ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:14.172673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:14.308972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fa55f-6216-4746-9b0b-b83be120ec16 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:14.389603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:14.423698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:14.424323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:14.424608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:14.424879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:14.426467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:14.638384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:14.639955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed761ee-28c1-4d97-9d7f-5914bb1d2620 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:14.660036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 730/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:00:16.994662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee503e2-972a-47a2-8647-dcd0d0329804 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:16.995216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee503e2-972a-47a2-8647-dcd0d0329804 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:16.995216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee503e2-972a-47a2-8647-dcd0d0329804 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:16.996595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 752/1482] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:17.002096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f4c22-5cb1-40b3-9bb6-e1116cee1793 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:17.005907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f4c22-5cb1-40b3-9bb6-e1116cee1793 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:17.005907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f4c22-5cb1-40b3-9bb6-e1116cee1793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:17.070228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3c6f4c22-5cb1-40b3-9bb6-e1116cee1793 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:17.071412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3c6f4c22-5cb1-40b3-9bb6-e1116cee1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:17.117104 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:17.166131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 731/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:17.463243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee503e2-972a-47a2-8647-dcd0d0329804 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:17.464842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fee503e2-972a-47a2-8647-dcd0d0329804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:17.489547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:17.568127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee503e2-972a-47a2-8647-dcd0d0329804 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:17.645599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:17.646206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:17.646483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:17.646753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:17.648357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:17.732932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:17.767947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:17.769418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59f614-7947-4a62-8e7d-9a6e2f752e41 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:17.788385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 753/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:00:20.033065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2628e-29d0-44eb-a8b0-709ba10c2fb2 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:20.033563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2628e-29d0-44eb-a8b0-709ba10c2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:20.033671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2628e-29d0-44eb-a8b0-709ba10c2fb2 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:20.035089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 732/1485] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:20.040241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652cf3-73b9-4cc6-a59d-a881326507ec None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:20.040689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652cf3-73b9-4cc6-a59d-a881326507ec None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:20.040823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76652cf3-73b9-4cc6-a59d-a881326507ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:20.104651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-76652cf3-73b9-4cc6-a59d-a881326507ec None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:20.105839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-76652cf3-73b9-4cc6-a59d-a881326507ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:20.201548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 754/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:20.504043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2628e-29d0-44eb-a8b0-709ba10c2fb2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:20.505622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-47f2628e-29d0-44eb-a8b0-709ba10c2fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:20.606939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2628e-29d0-44eb-a8b0-709ba10c2fb2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:20.680824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:20.682284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:20.682878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:20.683155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:20.683426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:20.685009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:20.796563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:20.798200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c41e8-5967-43bd-a8cd-1db958db88d6 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:20.815841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 733/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:00:23.143364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654618c-f658-43c1-be20-370ba96709e0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:23.143898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654618c-f658-43c1-be20-370ba96709e0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:23.143898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654618c-f658-43c1-be20-370ba96709e0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:23.145302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 755/1488] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:23.150596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611977be-fe8a-4ba2-b883-dcd89c6211a1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:23.151049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611977be-fe8a-4ba2-b883-dcd89c6211a1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:23.151151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611977be-fe8a-4ba2-b883-dcd89c6211a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:23.216097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-611977be-fe8a-4ba2-b883-dcd89c6211a1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:23.217335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-611977be-fe8a-4ba2-b883-dcd89c6211a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:23.270952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:23.315481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 734/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:23.615562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654618c-f658-43c1-be20-370ba96709e0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:23.617176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7654618c-f658-43c1-be20-370ba96709e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:23.653736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:23.722187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654618c-f658-43c1-be20-370ba96709e0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:23.795695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:23.796292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:23.796601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:23.796874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:23.799298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:23.879998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:23.909060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:23.910770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b62908-dc00-4804-ae52-4fea41bbfafe service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:23.929396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 756/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:00:26.480074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06164fb9-d87f-4c88-ac64-194ab18a7b11 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:26.480688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06164fb9-d87f-4c88-ac64-194ab18a7b11 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:26.480688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06164fb9-d87f-4c88-ac64-194ab18a7b11 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:26.482016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 735/1491] 10.222.0.26 () {54 vars in 927 bytes} [Thu Sep 15 11:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:00:26.487822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499e95-245c-4b41-a786-c2a5a730f16c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:26.488335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499e95-245c-4b41-a786-c2a5a730f16c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:26.488431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499e95-245c-4b41-a786-c2a5a730f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:26.557147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-03499e95-245c-4b41-a786-c2a5a730f16c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:00:26.558364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-03499e95-245c-4b41-a786-c2a5a730f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:26.654016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 757/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Sep 15 11:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:00:26.949703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06164fb9-d87f-4c88-ac64-194ab18a7b11 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:00:26.951225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-06164fb9-d87f-4c88-ac64-194ab18a7b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:27.059472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06164fb9-d87f-4c88-ac64-194ab18a7b11 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:00:27.133660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:00:27.134374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:00:27.134657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:00:27.134933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:00:27.136549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:00:27.145759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:27.247774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:00:27.249158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c36ab-5da1-4bc1-964f-12f2c310536b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:00:27.267311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 736/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:00:36.652538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=82 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:00:37.264959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=50 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:02:11.079752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.079752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.079752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.160468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:02:11.161654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:11.263833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 758/1494] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:02:11.271797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.272271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.272423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.292228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:02:11.293371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:11.302572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 737/1495] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:02:11.307076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:11.316623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ee92b-8a6a-43e6-9a24-a3dcd92dac48 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:11.321115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:11.321706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.321981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.322247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.322882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:02:11.323174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:11.324169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:11.324169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:02:11.324169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:02:11.325075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:11.336349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 759/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:02:11.345055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:11.354030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572911-8a59-4620-b974-c7cd431419a5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:11.358686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:11.359478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.360840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.362813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.363475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:11.366435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:11.366435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:02:11.366435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:02:11.367613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:11.499494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 738/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:02:11 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:02:11.503765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:11.514082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07b60-c20a-4c17-b7ab-6bbbcbebcda3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:11.563637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:02:11.570144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:11.570796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.571068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.571343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.571973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:11.573013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:11.573013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:02:11.573013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:02:11.577067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:11.669138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 760/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:02:11 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:02:11.674259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:11.684405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a733be-2569-4339-97a0-2e66e8c3f211 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:11.690161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:11.690782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.691061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.691334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.691969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:11.693013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:11.693013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:02:11.693013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:02:11.693884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:11.706756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 739/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:02:11.710731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:11.721005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523307-e8df-4cc2-9fb6-01c38e1535b5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:11.725778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:11.726371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.726650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.726950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.727587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:11.728764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:11.728764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:02:11.728764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:02:11.729640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a9724-14d1-43cf-83e2-2c0ac2f423d6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:11.744772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 761/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:02:11.749518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:11.759535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660f9a-9399-4880-b940-0357b8f62cfd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:11.764195 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:11.764944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.765228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.765527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] PATH_INFO: `/v3/projects/cf6d29933b0640b2bc13e46bace41dbe/users/42418554a6ec4725a2829d9d03395774/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.780706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6d29933b0640b2bc13e46bace41dbe, user_id=42418554a6ec4725a2829d9d03395774, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:11.781741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:11.781741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:02:11.781741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:02:11.783707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcb700-077c-4e4f-8f0a-b2bbff07eaef admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:11.834947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 740/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:02:11 2022] PUT /identity/v3/projects/cf6d29933b0640b2bc13e46bace41dbe/users/42418554a6ec4725a2829d9d03395774/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:02:11.853400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8187-e2d2-49fd-8112-2726d021e7dd None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.853688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8187-e2d2-49fd-8112-2726d021e7dd None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.853964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8187-e2d2-49fd-8112-2726d021e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.882462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3d4b8187-e2d2-49fd-8112-2726d021e7dd None None] MFA Rules not processed for user `42418554a6ec4725a2829d9d03395774`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:02:11.883657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3d4b8187-e2d2-49fd-8112-2726d021e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:11.947897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 762/1502] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:02:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:02:11.961267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1d50-9317-45f9-b279-dc3868279708 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.961555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1d50-9317-45f9-b279-dc3868279708 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.961825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd1d50-9317-45f9-b279-dc3868279708 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:11.963154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 741/1503] 10.222.0.26 () {54 vars in 964 bytes} [Thu Sep 15 11:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:02:11.968819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82f030-2a9f-40ca-9a97-c54b408847fe None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:11.969104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82f030-2a9f-40ca-9a97-c54b408847fe None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:11.969378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82f030-2a9f-40ca-9a97-c54b408847fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:12.028157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-fb82f030-2a9f-40ca-9a97-c54b408847fe None None] MFA Rules not processed for user `e538cfa7711a4ebf8868138f8520018a`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:02:12.029910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fb82f030-2a9f-40ca-9a97-c54b408847fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:12.104780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 763/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Sep 15 11:02:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:02:12.113167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1d50-9317-45f9-b279-dc3868279708 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:12.123636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd1d50-9317-45f9-b279-dc3868279708 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:12.127063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:12.127646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:12.127920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:12.128186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:12.136039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:12.137475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:12.146435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 742/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:02:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:02:12.191310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c733-a6fb-4a96-8b9a-c47ef6314e71 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:12.191600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c733-a6fb-4a96-8b9a-c47ef6314e71 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:12.191875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c733-a6fb-4a96-8b9a-c47ef6314e71 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:12.193179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 764/1506] 10.222.0.26 () {52 vars in 830 bytes} [Thu Sep 15 11:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:02:12.196734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:12.260578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937cb72-c665-4921-9eb2-27f18674ce44 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:12.265662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:12.266280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:12.266566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:12.266839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] PATH_INFO: `/v3/users/42418554a6ec4725a2829d9d03395774` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:12.267958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42418554a6ec4725a2829d9d03395774)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:12.269008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:12.269008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:02:12.269008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:02:12.270207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:12.502684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42418554a6ec4725a2829d9d03395774'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:12.555002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42418554a6ec4725a2829d9d03395774'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:12.555696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42418554a6ec4725a2829d9d03395774'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:12.556291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42418554a6ec4725a2829d9d03395774'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:12.571329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42418554a6ec4725a2829d9d03395774'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:12.593238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:02:12.602840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 743/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:02:12 2022] DELETE /identity/v3/users/42418554a6ec4725a2829d9d03395774 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:02:12.608354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:12.608873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:12.609340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:12.629098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:02:12.630303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:12.639701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:02:12.688910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 765/1508] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:02:12.698560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:12.699973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:12.777311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52cde8-a46f-44f0-b86d-eceac0731956 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:12.781408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fceba4-9f78-4900-87cd-5204c9035d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:12.782007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fceba4-9f78-4900-87cd-5204c9035d38 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:12.782282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fceba4-9f78-4900-87cd-5204c9035d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:12.782553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fceba4-9f78-4900-87cd-5204c9035d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:12.791207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fceba4-9f78-4900-87cd-5204c9035d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:12.792656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fceba4-9f78-4900-87cd-5204c9035d38 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:12.801930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 744/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:02:13.305650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:02:13.307116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:02:13.319206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df774f2-05a4-430b-a65e-e9c9c6b8a709 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:02:13.324761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:02:13.325570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:02:13.326670 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:02:13.327004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] PATH_INFO: `/v3/projects/cf6d29933b0640b2bc13e46bace41dbe` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:02:13.328169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6d29933b0640b2bc13e46bace41dbe)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:02:13.329243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:02:13.329243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:02:13.329243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:02:13.334589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:02:13.451216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6d29933b0640b2bc13e46bace41dbe', 'request_id': 'req-03bb3b41-aedb-47c3-9784-7527daaa2c59'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:13.464488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6d29933b0640b2bc13e46bace41dbe', 'request_id': 'req-03bb3b41-aedb-47c3-9784-7527daaa2c59'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:13.526581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6d29933b0640b2bc13e46bace41dbe', 'request_id': 'req-03bb3b41-aedb-47c3-9784-7527daaa2c59'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:13.538945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] The token cache is being invalidate because project cf6d29933b0640b2bc13e46bace41dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:02:13.539287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:13.539990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-03bb3b41-aedb-47c3-9784-7527daaa2c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:02:13.541639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 766/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:02:13 2022] DELETE /identity/v3/projects/cf6d29933b0640b2bc13e46bace41dbe => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:02:22.797810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:02:23.535872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:03:46.408755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c081be-d6f8-4f67-a2e8-a472d47833cc None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:46.409374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c081be-d6f8-4f67-a2e8-a472d47833cc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:46.409374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c081be-d6f8-4f67-a2e8-a472d47833cc None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:46.410680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 11:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:03:46.415601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee523d-20a9-4118-b29f-7159ed4b0ddc None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:46.416017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee523d-20a9-4118-b29f-7159ed4b0ddc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:46.416158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee523d-20a9-4118-b29f-7159ed4b0ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:46.437266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-57ee523d-20a9-4118-b29f-7159ed4b0ddc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:03:46.438447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-57ee523d-20a9-4118-b29f-7159ed4b0ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:03:46.495359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:03:46.651496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c081be-d6f8-4f67-a2e8-a472d47833cc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:03:46.653232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-41c081be-d6f8-4f67-a2e8-a472d47833cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:03:46.756209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c081be-d6f8-4f67-a2e8-a472d47833cc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:03:46.761749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f96d-1395-4d30-b251-1c7dee863ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:03:46.762354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f96d-1395-4d30-b251-1c7dee863ccd service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:46.762670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f96d-1395-4d30-b251-1c7dee863ccd service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:46.762944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f96d-1395-4d30-b251-1c7dee863ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:46.772255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f96d-1395-4d30-b251-1c7dee863ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:03:46.773666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f96d-1395-4d30-b251-1c7dee863ccd service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:03:46.783666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 746/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:03:47.894514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc205-5f66-424a-9cbc-9d4e6be50efb None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:47.895099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc205-5f66-424a-9cbc-9d4e6be50efb None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:47.895099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc205-5f66-424a-9cbc-9d4e6be50efb None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:47.896450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 11:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:03:47.902597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eed42-a1c8-4d9e-873e-9a841a64a0ef None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:47.903008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eed42-a1c8-4d9e-873e-9a841a64a0ef None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:47.903133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eed42-a1c8-4d9e-873e-9a841a64a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:47.922312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-543eed42-a1c8-4d9e-873e-9a841a64a0ef None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:03:47.923497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-543eed42-a1c8-4d9e-873e-9a841a64a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:03:47.931150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:03:48.084455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc205-5f66-424a-9cbc-9d4e6be50efb None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:03:48.098768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc205-5f66-424a-9cbc-9d4e6be50efb None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:03:48.104070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82983e75-c132-456a-90ae-073818e80c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:03:48.104788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983e75-c132-456a-90ae-073818e80c70 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:48.105063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983e75-c132-456a-90ae-073818e80c70 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:48.105333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82983e75-c132-456a-90ae-073818e80c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:48.113618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983e75-c132-456a-90ae-073818e80c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:03:48.115281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82983e75-c132-456a-90ae-073818e80c70 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:03:48.124995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 769/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:03:48.639716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751b82-0158-40e1-a000-feba098b2a2c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:48.640002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751b82-0158-40e1-a000-feba098b2a2c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:48.640283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751b82-0158-40e1-a000-feba098b2a2c None None] PATH_INFO: `/v3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:48.641607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 748/1517] 10.222.0.67 () {54 vars in 925 bytes} [Thu Sep 15 11:03:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:03:48.656085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9630e-dd31-4502-9bed-ad434be607d7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:48.656429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9630e-dd31-4502-9bed-ad434be607d7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:48.656702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9630e-dd31-4502-9bed-ad434be607d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:48.706839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-22c9630e-dd31-4502-9bed-ad434be607d7 None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:03:48.708035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-22c9630e-dd31-4502-9bed-ad434be607d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:03:48.779903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 770/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Sep 15 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:03:52.595792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0119-a9ce-41fe-b087-cf2bf3b21d04 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:52.596462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0119-a9ce-41fe-b087-cf2bf3b21d04 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:52.596746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0119-a9ce-41fe-b087-cf2bf3b21d04 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:52.598116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 749/1519] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 15 11:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:03:52.603116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded70a1-d7a4-4e96-b046-699d117e7fc8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:52.603543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded70a1-d7a4-4e96-b046-699d117e7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:52.603660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded70a1-d7a4-4e96-b046-699d117e7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:52.623079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-cded70a1-d7a4-4e96-b046-699d117e7fc8 None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:03:52.624250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cded70a1-d7a4-4e96-b046-699d117e7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:03:52.632672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 771/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 15 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:03:52.640982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0119-a9ce-41fe-b087-cf2bf3b21d04 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:03:52.654844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0119-a9ce-41fe-b087-cf2bf3b21d04 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:03:52.659641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3040d02-f5f7-48aa-88c6-6096fac53156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:03:52.660223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040d02-f5f7-48aa-88c6-6096fac53156 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:52.660534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040d02-f5f7-48aa-88c6-6096fac53156 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:52.660804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040d02-f5f7-48aa-88c6-6096fac53156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:52.668752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3040d02-f5f7-48aa-88c6-6096fac53156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:03:52.670310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3040d02-f5f7-48aa-88c6-6096fac53156 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:03:52.679596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 750/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:03:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:03:59.622496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfedb0-06b2-4348-87ee-81175d387637 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:59.623154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfedb0-06b2-4348-87ee-81175d387637 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:59.623154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfedb0-06b2-4348-87ee-81175d387637 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:59.624487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 11:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:03:59.630832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587b2a-86f2-4685-9030-6b5e7bad6346 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:59.631253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587b2a-86f2-4685-9030-6b5e7bad6346 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:59.631382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587b2a-86f2-4685-9030-6b5e7bad6346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:59.650445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cf587b2a-86f2-4685-9030-6b5e7bad6346 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:03:59.651645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf587b2a-86f2-4685-9030-6b5e7bad6346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:03:59.659384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:03:59.822375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfedb0-06b2-4348-87ee-81175d387637 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:03:59.845527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfedb0-06b2-4348-87ee-81175d387637 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:03:59.851234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4036-9997-4a53-bd3a-128161f31f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:03:59.851831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4036-9997-4a53-bd3a-128161f31f06 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:03:59.852106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4036-9997-4a53-bd3a-128161f31f06 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:03:59.852442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4036-9997-4a53-bd3a-128161f31f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:03:59.862020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f4036-9997-4a53-bd3a-128161f31f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:03:59.864035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f4036-9997-4a53-bd3a-128161f31f06 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:03:59.873585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 773/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:04:00.947562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a9ba-83ea-4ab6-897a-dc97070b12ee None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:00.948100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a9ba-83ea-4ab6-897a-dc97070b12ee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:00.948221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a9ba-83ea-4ab6-897a-dc97070b12ee None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:00.949573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:04:00.955722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedf921-dc1d-443b-8c05-77b3a39fe82b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:00.956183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedf921-dc1d-443b-8c05-77b3a39fe82b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:00.956280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedf921-dc1d-443b-8c05-77b3a39fe82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:00.975524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-afedf921-dc1d-443b-8c05-77b3a39fe82b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:04:00.976744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-afedf921-dc1d-443b-8c05-77b3a39fe82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:00.985037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 11:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:04:01.139416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200a9ba-83ea-4ab6-897a-dc97070b12ee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:04:01.153537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200a9ba-83ea-4ab6-897a-dc97070b12ee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:04:01.158902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3210c0-9be9-43b2-b54c-4d1ae4681e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:04:01.159495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3210c0-9be9-43b2-b54c-4d1ae4681e9c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:01.159778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3210c0-9be9-43b2-b54c-4d1ae4681e9c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:01.160054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3210c0-9be9-43b2-b54c-4d1ae4681e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:01.167984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3210c0-9be9-43b2-b54c-4d1ae4681e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:04:01.170131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3210c0-9be9-43b2-b54c-4d1ae4681e9c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:04:01.179301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 753/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:04:05.139713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62990970-ae09-4a55-b649-fb7e5dcf5414 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:05.140270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62990970-ae09-4a55-b649-fb7e5dcf5414 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:05.140270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62990970-ae09-4a55-b649-fb7e5dcf5414 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:05.141617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 11:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:04:05.146895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d107b-5bdd-49f4-a78e-817238af349f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:05.147342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d107b-5bdd-49f4-a78e-817238af349f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:05.147439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d107b-5bdd-49f4-a78e-817238af349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:05.166745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-797d107b-5bdd-49f4-a78e-817238af349f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:04:05.167932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-797d107b-5bdd-49f4-a78e-817238af349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:05.176343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 11:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:04:05.464959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62990970-ae09-4a55-b649-fb7e5dcf5414 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:04:05.466930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-62990970-ae09-4a55-b649-fb7e5dcf5414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:05.494304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:04:05.523564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62990970-ae09-4a55-b649-fb7e5dcf5414 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:04:05.527049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d10054-c996-4ed6-9bfd-8567bc25788c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:04:05.527687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d10054-c996-4ed6-9bfd-8567bc25788c service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:05.527999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d10054-c996-4ed6-9bfd-8567bc25788c service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:05.528380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d10054-c996-4ed6-9bfd-8567bc25788c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:05.537092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d10054-c996-4ed6-9bfd-8567bc25788c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:04:05.538488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d10054-c996-4ed6-9bfd-8567bc25788c service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:04:05.547661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 776/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:04:07.753780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36466b9-c6b0-490f-bda7-dd35ff019c33 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:07.754333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36466b9-c6b0-490f-bda7-dd35ff019c33 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:07.754333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36466b9-c6b0-490f-bda7-dd35ff019c33 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:07.755649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:04:07.761095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a004c6-f12f-4e4b-ba3d-3148447d7e0b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:07.761520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a004c6-f12f-4e4b-ba3d-3148447d7e0b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:07.761657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a004c6-f12f-4e4b-ba3d-3148447d7e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:07.782149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-24a004c6-f12f-4e4b-ba3d-3148447d7e0b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:04:07.783338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-24a004c6-f12f-4e4b-ba3d-3148447d7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:07.791019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:04:08.082413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36466b9-c6b0-490f-bda7-dd35ff019c33 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:04:08.093809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36466b9-c6b0-490f-bda7-dd35ff019c33 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:04:08.097318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf04e60-bee1-4750-9889-79d4ecbfc0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:04:08.097911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04e60-bee1-4750-9889-79d4ecbfc0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:08.098193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04e60-bee1-4750-9889-79d4ecbfc0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:08.098468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04e60-bee1-4750-9889-79d4ecbfc0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:08.107411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf04e60-bee1-4750-9889-79d4ecbfc0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:04:08.108880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf04e60-bee1-4750-9889-79d4ecbfc0e5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:04:08.118465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 756/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:04:11.861688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044ab95-278a-4a64-9472-94f81e26e9ec None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:11.862238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044ab95-278a-4a64-9472-94f81e26e9ec None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:11.862238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044ab95-278a-4a64-9472-94f81e26e9ec None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:11.863604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 11:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:04:11.868724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c0e37-581b-45ec-9b54-d193c7862b7d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:11.869130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c0e37-581b-45ec-9b54-d193c7862b7d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:11.869270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c0e37-581b-45ec-9b54-d193c7862b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:11.888780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dd4c0e37-581b-45ec-9b54-d193c7862b7d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:04:11.889950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd4c0e37-581b-45ec-9b54-d193c7862b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:11.897501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 11:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:04:12.200626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044ab95-278a-4a64-9472-94f81e26e9ec None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:04:12.202337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6044ab95-278a-4a64-9472-94f81e26e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:12.259965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044ab95-278a-4a64-9472-94f81e26e9ec None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:04:12.263521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc485c-fff2-4b4b-aa5d-d4352707f3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:04:12.264126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc485c-fff2-4b4b-aa5d-d4352707f3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:12.264501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc485c-fff2-4b4b-aa5d-d4352707f3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:12.264782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc485c-fff2-4b4b-aa5d-d4352707f3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:12.273871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc485c-fff2-4b4b-aa5d-d4352707f3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:04:12.275276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc485c-fff2-4b4b-aa5d-d4352707f3e3 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:04:12.285312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 779/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:04:14.450658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fd316-b812-46f3-9d8a-5c7b6630a3a7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:14.451204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fd316-b812-46f3-9d8a-5c7b6630a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:14.451204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fd316-b812-46f3-9d8a-5c7b6630a3a7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:14.452611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:04:14.458033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c604b7e-9a7a-4559-96f1-a374cfa8a328 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:14.458465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c604b7e-9a7a-4559-96f1-a374cfa8a328 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:14.458577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c604b7e-9a7a-4559-96f1-a374cfa8a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:14.478535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2c604b7e-9a7a-4559-96f1-a374cfa8a328 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:04:14.479714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2c604b7e-9a7a-4559-96f1-a374cfa8a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:14.488609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:04:14.793532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fd316-b812-46f3-9d8a-5c7b6630a3a7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:04:14.795379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-278fd316-b812-46f3-9d8a-5c7b6630a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:04:14.802949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=77 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:04:14.808778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fd316-b812-46f3-9d8a-5c7b6630a3a7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:04:14.817573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04ad2b-3075-40ab-8493-5a7e4a5f164a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:04:14.817573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04ad2b-3075-40ab-8493-5a7e4a5f164a service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:04:14.817573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04ad2b-3075-40ab-8493-5a7e4a5f164a service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:04:14.817573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04ad2b-3075-40ab-8493-5a7e4a5f164a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:04:14.822048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04ad2b-3075-40ab-8493-5a7e4a5f164a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:04:14.823490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04ad2b-3075-40ab-8493-5a7e4a5f164a service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:04:14.833296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 759/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:04:24.473193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=47 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:04:24.836012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:45.189058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c333b-fde4-40f2-b0c3-a37e95d9e245 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.189743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c333b-fde4-40f2-b0c3-a37e95d9e245 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.189743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c333b-fde4-40f2-b0c3-a37e95d9e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.220186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.220806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.220806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.222440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-616c333b-fde4-40f2-b0c3-a37e95d9e245 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.223657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-616c333b-fde4-40f2-b0c3-a37e95d9e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.235566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 781/1540] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:05:45.244713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471878ff-072f-4aa7-8725-d41e752d176a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.245022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471878ff-072f-4aa7-8725-d41e752d176a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.245286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471878ff-072f-4aa7-8725-d41e752d176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.255186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.256417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.271646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-471878ff-072f-4aa7-8725-d41e752d176a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.278349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-471878ff-072f-4aa7-8725-d41e752d176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.286513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 760/1541] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:05:45.287282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 782/1542] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:05:45.291961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.296521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.296969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.297260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.317768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a77b-a733-4334-884b-3116d07bd730 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.329097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.330805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.342248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.343057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.343342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.343621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.344283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:45.344616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.345644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:05:45.345644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:05:45.345644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:05:45.346801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61441ec3-c73c-4888-ba85-2cd04a201a3e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.348299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 783/1543] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:05:45.353527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.367604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c39ff-e6e5-41ba-bdd2-e10a802a89e5 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.377969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 761/1544] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:45.379271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.379552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.379832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.382959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.383875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.384406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.384905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.386182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:45.386701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.388533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.410862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 784/1545] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:05:45.412138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.417400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.418615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.435552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa7447-8c94-4d34-bfe0-1bb1d9093dbb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.444411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.445382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.445894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.446396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.447252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.448509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:05:45.448509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:05:45.448509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:05:45.450084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 762/1546] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.450363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193c75c-f7b4-4c31-8673-d2000d63692c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.451054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.470461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7d2e1-d412-44db-92e1-eafe7604b932 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.488154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aec507-4b69-4ee9-ae30-1ed14637d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.488826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aec507-4b69-4ee9-ae30-1ed14637d76f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.489109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aec507-4b69-4ee9-ae30-1ed14637d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.489384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aec507-4b69-4ee9-ae30-1ed14637d76f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.490190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aec507-4b69-4ee9-ae30-1ed14637d76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.492510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aec507-4b69-4ee9-ae30-1ed14637d76f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.600012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 785/1547] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:45.602256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6923-ea73-449c-9a1b-9f3b128e3825 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.602688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6923-ea73-449c-9a1b-9f3b128e3825 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.603021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d6923-ea73-449c-9a1b-9f3b128e3825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.622806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 763/1548] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/projects => generated 403 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:45.624150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b19417-0039-4eeb-81cb-14aec8af4cd7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.624475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b19417-0039-4eeb-81cb-14aec8af4cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.624750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-842d6923-ea73-449c-9a1b-9f3b128e3825 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.624874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b19417-0039-4eeb-81cb-14aec8af4cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.625904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-842d6923-ea73-449c-9a1b-9f3b128e3825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.643792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-84b19417-0039-4eeb-81cb-14aec8af4cd7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.644992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-84b19417-0039-4eeb-81cb-14aec8af4cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.686124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 786/1549] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.687373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f85f-b5fd-46bc-a627-055f49d4c5b1 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.687658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f85f-b5fd-46bc-a627-055f49d4c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.687973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f85f-b5fd-46bc-a627-055f49d4c5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.716619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9901f85f-b5fd-46bc-a627-055f49d4c5b1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.716849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 764/1550] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.716983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9901f85f-b5fd-46bc-a627-055f49d4c5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.717077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cddf-9976-4372-a87c-def721411211 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.717077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cddf-9976-4372-a87c-def721411211 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.717077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cddf-9976-4372-a87c-def721411211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.717301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 787/1551] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.717778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabe9bf-a4aa-4dc6-af90-ab81a5a34589 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.717958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabe9bf-a4aa-4dc6-af90-ab81a5a34589 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.718235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabe9bf-a4aa-4dc6-af90-ab81a5a34589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.736626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5248cddf-9976-4372-a87c-def721411211 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.738176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5248cddf-9976-4372-a87c-def721411211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.742245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4cabe9bf-a4aa-4dc6-af90-ab81a5a34589 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.745192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4cabe9bf-a4aa-4dc6-af90-ab81a5a34589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.747063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 765/1552] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.747654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248cddf-9976-4372-a87c-def721411211 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.758229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 788/1553] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.759817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.760053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248cddf-9976-4372-a87c-def721411211 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.760177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.760401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.764701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.765301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.765639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.765903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.766523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.767537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:05:45.767537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:05:45.767537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:05:45.768762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.780457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.783496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.790308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 789/1554] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.791158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.800423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929880d-dd1c-4a6c-be88-f77bc8c29ea5 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.805682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe905a-3824-487e-ad7d-5fc88e076fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.806267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe905a-3824-487e-ad7d-5fc88e076fce admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.806547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe905a-3824-487e-ad7d-5fc88e076fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.806828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe905a-3824-487e-ad7d-5fc88e076fce admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.807449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe905a-3824-487e-ad7d-5fc88e076fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.809453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe905a-3824-487e-ad7d-5fc88e076fce admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.862600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 766/1555] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:45.862600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.871814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37586e8a-3ff0-41f3-9e26-f84a4fe8791f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.876548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.877157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.877436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.877709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.878344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:45.878667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.880336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783515-822d-47c4-baf6-de8d218f24aa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.893598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 767/1556] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:45.894826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07994-c2c6-4e96-b06a-82fb457d34f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.895106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07994-c2c6-4e96-b06a-82fb457d34f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.895378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07994-c2c6-4e96-b06a-82fb457d34f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.895549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 790/1557] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:45.896917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0fc5e-4706-483c-83b0-41671ffe7807 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.897206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0fc5e-4706-483c-83b0-41671ffe7807 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.897483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0fc5e-4706-483c-83b0-41671ffe7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.920016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8ea07994-c2c6-4e96-b06a-82fb457d34f7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.920212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-dff0fc5e-4706-483c-83b0-41671ffe7807 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.921302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dff0fc5e-4706-483c-83b0-41671ffe7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.921448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8ea07994-c2c6-4e96-b06a-82fb457d34f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.929216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 768/1558] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.932933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 791/1559] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.933067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.933152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580231-b9a0-48f3-b86e-6c0aa21f848d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.933243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.933320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580231-b9a0-48f3-b86e-6c0aa21f848d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.933400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.933480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a580231-b9a0-48f3-b86e-6c0aa21f848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.950581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.950799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-8a580231-b9a0-48f3-b86e-6c0aa21f848d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.951759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8a580231-b9a0-48f3-b86e-6c0aa21f848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.951876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.959414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 792/1560] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.959857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 769/1561] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.962217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.965077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.965357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.965628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.971892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc8a50-6ceb-4b7b-89a3-76e20729bdd1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:45.977074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:45.977671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:45.977953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:45.978229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:45.978869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:45.980483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:45.985323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:45.986492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:45.990593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 770/1562] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:45.991371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:45.994673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 793/1563] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:45.995494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.000930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309136c-ba0f-4c6b-a982-468abdc212ec admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.004878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae0373-4a4c-4a69-813a-2b51be1deefc None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.005701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.006288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.006568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.006844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.007589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.009359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.009744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.010331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.010618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.010871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.011492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.013383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.019556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 771/1564] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:46.020368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.033445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba1889-a66a-4f25-98c7-f87c4d1e3006 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.039299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.041253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.041253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.041253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.041253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:46.041631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.043064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.055412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 772/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:46.056198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.065490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462773d-9a90-4681-8108-4d7482f69926 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.070132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.073386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.073386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.073386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.073386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:46.073386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.073846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.085148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 773/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:46.086687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.096102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f439176-83b5-434e-801d-d5164e0f86b2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.100696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.101919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.102205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.102345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 794/1567] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:45 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.102594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.103166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:46.103457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.103565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.105058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.115149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:46.118681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 774/1568] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:46.119522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.129062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6af7-27ea-4bc0-bffa-43d30aa530f8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.136607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:46.169572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba04336-3cad-4f5b-99c4-002f608fa850 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.174266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.174868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.175147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.175421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.176073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:46.176397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.177992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.185635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.186248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.186527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.186854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.187493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.189143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.190237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 795/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:46.191106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.202353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06c53-6954-433c-9d60-a3c2133bec57 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.205317 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 775/1570] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:46.206221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.207133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.207785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.208070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.208617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.209153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:46.209460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.211839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.217295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090490f8-5729-46f9-8ca3-c08112dc9bbb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.235797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.235797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.235797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.235797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.236848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.236959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 796/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:46.237054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.237159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.237159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706cd6-364e-4b89-b83c-0add539f5614 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.241231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 776/1572] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:46.241745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.242273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.242553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.242839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.243152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.243734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.245681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.252557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53435d-0f0a-458d-8d5b-5ac581abbc91 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.257952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.258453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.258762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.259276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.260154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.262784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.351865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 797/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.352097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 777/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.352200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.352370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.412479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe9427-6b63-4728-a01a-e554ad15b8cd admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.413978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c096-2aa2-4b62-94c9-04d63abf7d55 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.417373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.417974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.418250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.418521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.418988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.419141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.419591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.419892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.420276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.420936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.421066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.422858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.524817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 798/1575] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.525686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.535080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312b5cf-a08c-4062-b0db-c383b4acf845 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.539766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.540365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.540651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.540929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.541539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.543463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.551206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 778/1576] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.552007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.601193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:46.614283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ee0a-16e1-4aa1-bf3f-ff02f6e8c333 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.619537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.620489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.620770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.621044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] PATH_INFO: `/v3/projects/12d50f3dbe3e4c8b945ce26e68437aa8/users/800d839dac4b44a987aebdc4d1ef8e91/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.628083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 799/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.628921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.637459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d50f3dbe3e4c8b945ce26e68437aa8, user_id=800d839dac4b44a987aebdc4d1ef8e91, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.640160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.681518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:46.691498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3095b02-7291-4438-b1e2-37266dcc49c8 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.696297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.696965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.697243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.697516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.698143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.700028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.713738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 779/1578] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:46 2022] PUT /identity/v3/projects/12d50f3dbe3e4c8b945ce26e68437aa8/users/800d839dac4b44a987aebdc4d1ef8e91/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:46.714653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.776294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fa133-f621-4370-81a6-7266d7b9c020 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.780841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.781524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.781800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.782077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] PATH_INFO: `/v3/projects/c3f26ce082af406f9e6b83899a4c3500/users/5cc79d38d82d44ea806d22fb91b89fe4/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.796600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f26ce082af406f9e6b83899a4c3500, user_id=5cc79d38d82d44ea806d22fb91b89fe4, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.799221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.808223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 800/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.809250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.871038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d52bb-6c90-47d4-83ee-d3020c49d9e3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.875681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.876283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.876592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.876866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.877489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.879428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.887756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 780/1580] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:46 2022] PUT /identity/v3/projects/c3f26ce082af406f9e6b83899a4c3500/users/5cc79d38d82d44ea806d22fb91b89fe4/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:46.889156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.954324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5973e-9243-430d-bc07-ee2e409ca3e5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.959037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.959775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.960056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.960650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.961292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.963200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:46.981422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 801/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:46.982273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:46.992139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2bfd0-f1f3-4d3c-99bf-e1383ea5f209 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:46.996657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:46.997228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:46.997503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:46.997776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:46.998394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:46.999962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.010177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 802/1582] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.010920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.019843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24a54a-fdba-4c25-b2e9-33f2a5b6f8ac admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.024919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b56da3-1bb7-4159-8323-2a8ef4241fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.026942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56da3-1bb7-4159-8323-2a8ef4241fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.026942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56da3-1bb7-4159-8323-2a8ef4241fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.026942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b56da3-1bb7-4159-8323-2a8ef4241fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.026942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56da3-1bb7-4159-8323-2a8ef4241fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.028451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b56da3-1bb7-4159-8323-2a8ef4241fd4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.053008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 781/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:46 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.054330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.063687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03b313-0ca8-4f68-88cf-0f97650adff4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.068234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.068854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.069135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.069407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.070719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.072597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.128519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 803/1584] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.129956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e74ca-abb4-47be-848d-62350a841de7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.130239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e74ca-abb4-47be-848d-62350a841de7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.130509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e74ca-abb4-47be-848d-62350a841de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.152682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 782/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.153629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.160546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d60e74ca-abb4-47be-848d-62350a841de7 None None] MFA Rules not processed for user `800d839dac4b44a987aebdc4d1ef8e91`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:47.161753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d60e74ca-abb4-47be-848d-62350a841de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:47.165659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282f56e-1a98-4263-9ac9-6a777f532ec4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.170266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.170859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.171139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.171412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.172059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.173956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.229853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 804/1586] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:47.231148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.231411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.231682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.250173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 783/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.251008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.261789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539f09-b2d4-47e6-848e-1be8b6353f83 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.262512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] MFA Rules not processed for user `5cc79d38d82d44ea806d22fb91b89fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:47.263695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:47.266364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.266959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.267237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.267509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.268144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.269761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.272006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:47.283952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:47.284168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 784/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.284168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.292547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b8e7-c796-4ced-b261-e45acfba35a1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.297365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.297945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.298366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.298648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.299309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.300946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.312135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 785/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.313195 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.323650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136a3b2-bd26-41c1-8ad3-3776d7f7576a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.328235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.329909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.329909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.329909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.330192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.331603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.333597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 805/1590] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:47.334491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.342545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 786/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.343428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.348266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010f03-aca4-479e-bb64-a6493ef227f7 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.353756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.358991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7285-0e1b-4ba3-ba7f-a91691877236 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.359147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.359147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.359147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.359147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.359669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.359837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.360001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.360001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.360001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.360691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.362264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.370388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 806/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.371193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.374864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 787/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.375814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.380838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1260-04d3-4bb1-8327-297742c455c8 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.386369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.386968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c474db-629d-46fc-af56-1d434202da98 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.392348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.392348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.392348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.392348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.392348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.392781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.392781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.392781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.392781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.393229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.394777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.405150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 788/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.405955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.415644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bebf5-7e05-4973-b238-57352caa01e2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.420179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.420780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.421097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.421364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.421975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.423945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.435338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 789/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.436193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.446425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d713-a928-45b3-b885-2e1d06e608d7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.450962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.451626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.451908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.452185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] PATH_INFO: `/v3/projects/e569a1f8ad2f4d8f83e36847dd60fbe8/users/ee5a39429425478eba6d6a4b1fb9f37b/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.467192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e569a1f8ad2f4d8f83e36847dd60fbe8, user_id=ee5a39429425478eba6d6a4b1fb9f37b, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.470904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 807/1596] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.470904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.471149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.531720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25485e-c749-47d0-a7e4-ea76b8019839 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.536565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.537125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.537401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.537674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.538613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.541128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.558720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 790/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:47 2022] PUT /identity/v3/projects/e569a1f8ad2f4d8f83e36847dd60fbe8/users/ee5a39429425478eba6d6a4b1fb9f37b/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:47.565278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.621704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87e10a-da1f-4708-9d78-cb491f44021f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.626238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.626837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.627119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.627395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.628032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.629685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.639930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 791/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.640654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.651413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 808/1599] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/projects => generated 401 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.651751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6f725-2dfe-4e77-ab67-69159d2ae88b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.652271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.708415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.709034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.709346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.709623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.710286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.711917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.714397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b810-6305-4495-8311-4eec9d33a6d1 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.719003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.719596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.719871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.720141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.720807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.721615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 792/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.722371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.722470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.736111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 809/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.736111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.736407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f465ce4-7889-489b-9841-b186e39b63e6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.739732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.740349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.740638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.740925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.741624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.743237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.743359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a65d1-edc9-421a-a767-0753eaf1a342 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.748123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.748496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:47.749284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.749424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.749659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] PATH_INFO: `/v3/projects/98a75b0c21f042539f22274a5eab66f1/users/0eac81d7fb9b4a58ae8023bfd5709d9f/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.751934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:47.754096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 793/1602] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:47.760033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.764974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016dcdd-c14e-4c39-b612-f189c84a70ae admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.766803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a75b0c21f042539f22274a5eab66f1, user_id=0eac81d7fb9b4a58ae8023bfd5709d9f, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.767873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:05:47.767873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:05:47.767873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:05:47.769766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.769936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23ba63-abc6-4cf5-8f4a-edf94fd792ad admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.770397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.770668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.770961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.771771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.774080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.849985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 810/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:47 2022] PUT /identity/v3/projects/98a75b0c21f042539f22274a5eab66f1/users/0eac81d7fb9b4a58ae8023bfd5709d9f/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:47.851974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.852601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.853171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.860129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 794/1604] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:47.861171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.873006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001036f-c803-45ec-a100-a3ef0f257323 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.883232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] MFA Rules not processed for user `ee5a39429425478eba6d6a4b1fb9f37b`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:47.884593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:47.928890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.931056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.931520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.931832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] PATH_INFO: `/v3/projects/025a7d4499644843aa3329355d0c6f99/users/39133da0b7e049f09431c6e3d015f567/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.946540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025a7d4499644843aa3329355d0c6f99, user_id=39133da0b7e049f09431c6e3d015f567, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.949205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:47.950710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 811/1605] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:47.952162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:47.962568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fb3ed-2ddf-4d44-96fd-4e297ef3daba None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:47.967086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:47.967686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:47.972995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:47.972995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:47.972995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:47.972995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.023843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 795/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:47 2022] PUT /identity/v3/projects/025a7d4499644843aa3329355d0c6f99/users/39133da0b7e049f09431c6e3d015f567/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:48.024947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.057247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 812/1607] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:47 2022] POST /identity/v3/users => generated 307 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:48.057247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.068829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde6700-d721-475a-9c22-1d5fa2a10ee7 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.089012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5753-2cb9-49c8-8f7e-fe8c9db39ea3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.093534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.097701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.097701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.097701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] PATH_INFO: `/v3/projects/9dffbf8b5d1141308592ef8a2ca7fc95/users/d8d1da88813d49cf9abb7b626a94259e/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.110135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dffbf8b5d1141308592ef8a2ca7fc95, user_id=d8d1da88813d49cf9abb7b626a94259e, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.112812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.126971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d61922-ab22-4c8e-9fb2-a3be250f5715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.127702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d61922-ab22-4c8e-9fb2-a3be250f5715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.127996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d61922-ab22-4c8e-9fb2-a3be250f5715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.128256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d61922-ab22-4c8e-9fb2-a3be250f5715 admin admin] PATH_INFO: `/v3/projects/9c7cc5b2fd13440e8256a957874e6684/users/5111139cdb444281b95871311f9c7f5d/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.142524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d61922-ab22-4c8e-9fb2-a3be250f5715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7cc5b2fd13440e8256a957874e6684, user_id=5111139cdb444281b95871311f9c7f5d, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.145169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d61922-ab22-4c8e-9fb2-a3be250f5715 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.184881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 796/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:48 2022] PUT /identity/v3/projects/9dffbf8b5d1141308592ef8a2ca7fc95/users/d8d1da88813d49cf9abb7b626a94259e/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:48.187369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.214504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 813/1609] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:48 2022] PUT /identity/v3/projects/9c7cc5b2fd13440e8256a957874e6684/users/5111139cdb444281b95871311f9c7f5d/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:48.218136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.218136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.218136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.236212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:48.237494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:48.245115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:48.263097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e9f8-2a0d-43c9-8b3c-878db84c91c4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.273898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:48.304831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 814/1610] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:48.305691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.315095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec92540-4ef6-48b5-8bec-b981916ba48e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.319886 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.320527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.320808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.321087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.321726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.323552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.326368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f4a1f-46f8-4846-9af3-2bfc6cbf205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.327027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4a1f-46f8-4846-9af3-2bfc6cbf205b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.327349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4a1f-46f8-4846-9af3-2bfc6cbf205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.327627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f4a1f-46f8-4846-9af3-2bfc6cbf205b admin admin] PATH_INFO: `/v3/projects/10b367182e084780a3349c99b5a7787b/users/0ea736407a9846e9899e10a8320e692a/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.338062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 815/1611] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:48.338062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.344049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4a1f-46f8-4846-9af3-2bfc6cbf205b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b367182e084780a3349c99b5a7787b, user_id=0ea736407a9846e9899e10a8320e692a, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.345723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc2f63-c812-43b1-98bf-692789e5ec06 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.346942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f4a1f-46f8-4846-9af3-2bfc6cbf205b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.351575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.352165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.352485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.352765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.353415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.355311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.426337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 797/1612] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:48 2022] PUT /identity/v3/projects/10b367182e084780a3349c99b5a7787b/users/0ea736407a9846e9899e10a8320e692a/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:48.427648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c6d9-093b-49b5-b577-e3e4d659eb09 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.427933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c6d9-093b-49b5-b577-e3e4d659eb09 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.428203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c6d9-093b-49b5-b577-e3e4d659eb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.446757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-20c9c6d9-093b-49b5-b577-e3e4d659eb09 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:48.447967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-20c9c6d9-093b-49b5-b577-e3e4d659eb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:48.457663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 816/1613] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:48.457663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.526109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315af294-a740-4e6d-a523-7aec87a0c4cf admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.527861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 798/1614] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:48.529405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.529750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.529997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.531366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd311-466c-4f52-8e38-a40d1d351996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.531976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd311-466c-4f52-8e38-a40d1d351996 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.532426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd311-466c-4f52-8e38-a40d1d351996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.532704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd311-466c-4f52-8e38-a40d1d351996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.533404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd311-466c-4f52-8e38-a40d1d351996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.534956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd311-466c-4f52-8e38-a40d1d351996 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.549284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 817/1615] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:48.549284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e69d-8152-4121-9795-f8862d269053 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.549284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e69d-8152-4121-9795-f8862d269053 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.549284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e69d-8152-4121-9795-f8862d269053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.551130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:48.552076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:48.560563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 799/1616] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:48.561345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.568950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e108e69d-8152-4121-9795-f8862d269053 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:48.570739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e108e69d-8152-4121-9795-f8862d269053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:48.578817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 818/1617] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:48.580111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108e69d-8152-4121-9795-f8862d269053 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.590043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108e69d-8152-4121-9795-f8862d269053 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.594754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.597553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.597553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.597553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] PATH_INFO: `/v3/projects/fac83fa3508e4ae3a345e7b814ea38c1/users/3278e53b48404e3493810711245cf7d7/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.612772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac83fa3508e4ae3a345e7b814ea38c1, user_id=3278e53b48404e3493810711245cf7d7, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.615556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.619957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a940585-472b-4822-8be4-1d30a1bed0e6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.623495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b4bde-6571-4485-9d76-f888b10bae4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.624097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b4bde-6571-4485-9d76-f888b10bae4f service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.624404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b4bde-6571-4485-9d76-f888b10bae4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.624678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b4bde-6571-4485-9d76-f888b10bae4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.633772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b4bde-6571-4485-9d76-f888b10bae4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.635178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b4bde-6571-4485-9d76-f888b10bae4f service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.644408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 800/1618] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:48.645662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.645963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.646224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.665486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:48.666683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:48.675390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 801/1619] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:48.676327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.686617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259bb4d-531d-4a3b-b520-71073a12cbf3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.691947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 819/1620] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:48 2022] PUT /identity/v3/projects/fac83fa3508e4ae3a345e7b814ea38c1/users/3278e53b48404e3493810711245cf7d7/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:48.691947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.693663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:48.746925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24283-56f0-4025-9609-2150716f44ce admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.749821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.750428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.750641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.750786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.750961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.751239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.751517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.751609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.751788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.753490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.761516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.762915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.775899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 820/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:48.776965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.785943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf2bf-735f-424c-89c3-0606fe0ef538 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:48.791426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:48.792080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:48.792417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:48.792697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] PATH_INFO: `/v3/projects/90ad8c3e79c04eecb5957c88653d234a/users/6d2d259b701b4ab3857a904dc4864e57/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:48.809895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:48.815458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ad8c3e79c04eecb5957c88653d234a, user_id=6d2d259b701b4ab3857a904dc4864e57, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:48.818518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:48.971101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 821/1622] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:48 2022] PUT /identity/v3/projects/90ad8c3e79c04eecb5957c88653d234a/users/6d2d259b701b4ab3857a904dc4864e57/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:48.971302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 802/1623] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:48 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:48.971302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.972948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:48.982742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7dfea-8119-40f8-90d9-5fe546173a67 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.041956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3368db-d130-4f24-8434-0a99eb0e26ad admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.046217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.046670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.047283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.047985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.047985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.048339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.048779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.049265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.119116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.122471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.126961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.133283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.133821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 803/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:49.133821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.142756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05686f-6652-4a0a-94e7-2d65c81ec608 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.146925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.148255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.148574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.148850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.160679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 822/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:49.161376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.162877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.163163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.175722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 804/1626] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:49.176686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.178109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f56f9a-cbe7-4b5f-ada0-1c92710a5f63 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.185475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.186579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.187049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.187510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.188526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.189228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29960845-8e21-458b-9e6c-01c0b43cf6f9 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.191486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.195796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.196498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.196824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.197142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.198014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.200027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.207397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 823/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:49.211442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.216423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 805/1628] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:49.217631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.223129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1e1d-8f60-494a-8a2d-afae15225f03 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.231054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.231612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.232005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.232405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.232905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b275e8-5270-4943-9616-4dd6d36e523e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.233975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.235718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.238084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.247086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.247086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.247086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] PATH_INFO: `/v3/projects/fac83fa3508e4ae3a345e7b814ea38c1/users/3278e53b48404e3493810711245cf7d7/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.247086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac83fa3508e4ae3a345e7b814ea38c1, user_id=3278e53b48404e3493810711245cf7d7, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.247086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.249196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 824/1629] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:49.250268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.264506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 806/1630] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:49 2022] PUT /identity/v3/projects/fac83fa3508e4ae3a345e7b814ea38c1/users/3278e53b48404e3493810711245cf7d7/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:49.264506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.265187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470645a3-ce9c-4d38-8024-d5da494b3f40 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.283589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:49.331794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d086f2d-6de6-49ea-b49c-85f2c55af2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.332541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d086f2d-6de6-49ea-b49c-85f2c55af2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.332838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d086f2d-6de6-49ea-b49c-85f2c55af2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.333105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d086f2d-6de6-49ea-b49c-85f2c55af2b2 admin admin] PATH_INFO: `/v3/projects/90ad8c3e79c04eecb5957c88653d234a/users/6d2d259b701b4ab3857a904dc4864e57/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.335212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d086f2d-6de6-49ea-b49c-85f2c55af2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ad8c3e79c04eecb5957c88653d234a, user_id=6d2d259b701b4ab3857a904dc4864e57, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.338080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d086f2d-6de6-49ea-b49c-85f2c55af2b2 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.343424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584abaae-3c8b-4cd2-b72a-0de7308316eb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.349953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 825/1631] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:49 2022] PUT /identity/v3/projects/90ad8c3e79c04eecb5957c88653d234a/users/6d2d259b701b4ab3857a904dc4864e57/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:49.351835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaad61b-756c-4f15-a617-2902086d2b13 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.352267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaad61b-756c-4f15-a617-2902086d2b13 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.352693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaad61b-756c-4f15-a617-2902086d2b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.378945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:49.387902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-edaad61b-756c-4f15-a617-2902086d2b13 None None] MFA Rules not processed for user `3278e53b48404e3493810711245cf7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:49.389360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-edaad61b-756c-4f15-a617-2902086d2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:49.445485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.447022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.447022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.447022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] PATH_INFO: `/v3/projects/3101ded2edcf40c89734afd9b55deec6/users/e48c2108eae847bfb707a9efb09a3922/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.465233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3101ded2edcf40c89734afd9b55deec6, user_id=e48c2108eae847bfb707a9efb09a3922, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.469253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.481335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 826/1632] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:49.483024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.483483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.484106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.515841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] MFA Rules not processed for user `6d2d259b701b4ab3857a904dc4864e57`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:49.517619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:49.591933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 807/1633] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:49 2022] PUT /identity/v3/projects/3101ded2edcf40c89734afd9b55deec6/users/e48c2108eae847bfb707a9efb09a3922/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:49.593080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.607769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 827/1634] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:49.609453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.624870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99302c9e-8e33-48c1-acca-2d1005bf108a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.680675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421644-4c6a-4a0e-ae42-0500ee206973 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.687264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.687917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.688205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.688513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.722101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.722820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.723196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.723564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.724328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.726851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.744736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 828/1635] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:49.745749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.758938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422cb2-7ab8-432e-809e-82c60e08a7cd admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.763320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca92c7-0346-4ee7-a24b-93d26d1b7227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.764053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca92c7-0346-4ee7-a24b-93d26d1b7227 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.765094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca92c7-0346-4ee7-a24b-93d26d1b7227 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.765094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca92c7-0346-4ee7-a24b-93d26d1b7227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.786099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:49.789419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:49.807107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.808970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.828279 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 808/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:49.829230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:49.856209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb38334-c6b8-4928-87b5-aa83b2a14772 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:49.858431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca92c7-0346-4ee7-a24b-93d26d1b7227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.861664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca92c7-0346-4ee7-a24b-93d26d1b7227 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.867658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:49.868548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.869421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.869773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] PATH_INFO: `/v3/projects/3101ded2edcf40c89734afd9b55deec6/users/e48c2108eae847bfb707a9efb09a3922/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.872169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3101ded2edcf40c89734afd9b55deec6, user_id=e48c2108eae847bfb707a9efb09a3922, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:49.875975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 829/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:49.880876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:49.893118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 809/1638] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:49 2022] PUT /identity/v3/projects/3101ded2edcf40c89734afd9b55deec6/users/e48c2108eae847bfb707a9efb09a3922/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:49.904435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:49.906989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:49.906989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:49.939777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] MFA Rules not processed for user `e48c2108eae847bfb707a9efb09a3922`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:49.941109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:50.082212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 830/1639] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:50.148819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:50.279937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:50.281248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3e095-c33f-46fc-a725-765cc86c7e32 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:50.286089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:50.286715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:50.286996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:50.287275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:50.303497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:50.305425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:50.319269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 810/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:50.321501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:50.333507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb0315-ed85-493a-8127-23c2c0a296f3 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:50.339710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0489fc-1089-4184-8427-81675fcc0b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:50.341383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0489fc-1089-4184-8427-81675fcc0b73 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:50.341742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0489fc-1089-4184-8427-81675fcc0b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:50.342504 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0489fc-1089-4184-8427-81675fcc0b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:50.443091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22b83-e401-4624-9235-5231b4ffcee2 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:50.445885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0489fc-1089-4184-8427-81675fcc0b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:50.447453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0489fc-1089-4184-8427-81675fcc0b73 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:50.448776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:50.449411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:50.449733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:50.450011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] PATH_INFO: `/v3/users/5cc79d38d82d44ea806d22fb91b89fe4` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:50.451183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc79d38d82d44ea806d22fb91b89fe4)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:50.452190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: WARNING py.warnings [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:05:50.452190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: warnings.warn(msg) Sep 15 11:05:50.452190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: Sep 15 11:05:50.453417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:50.457945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 811/1641] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:50.964142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:50.964142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc79d38d82d44ea806d22fb91b89fe4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:50.964142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc79d38d82d44ea806d22fb91b89fe4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:50.964142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc79d38d82d44ea806d22fb91b89fe4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:50.964142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc79d38d82d44ea806d22fb91b89fe4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:50.965035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc79d38d82d44ea806d22fb91b89fe4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:51.030513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 831/1642] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:05:50 2022] DELETE /identity/v3/users/5cc79d38d82d44ea806d22fb91b89fe4 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:05:51.035162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:51.035572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:51.035973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:51.060617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:51.062387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:51.187197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 812/1643] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:51.204645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:51.204645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:51.345907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e79f-e571-4655-83c7-ebc554d222a3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:51.354903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9336-14ee-4c99-8fc2-e3926701ff85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:51.356093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9336-14ee-4c99-8fc2-e3926701ff85 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:51.356624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9336-14ee-4c99-8fc2-e3926701ff85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:51.357052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9336-14ee-4c99-8fc2-e3926701ff85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:51.369708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b9336-14ee-4c99-8fc2-e3926701ff85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:51.371979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b9336-14ee-4c99-8fc2-e3926701ff85 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:51.386020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 832/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:51.893995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:51.895716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:51.908894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b8e84-b038-45c4-8f15-3ae5719dc0cc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:51.914909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:51.919395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:51.919395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:51.919395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] PATH_INFO: `/v3/users/ee5a39429425478eba6d6a4b1fb9f37b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:51.919395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5a39429425478eba6d6a4b1fb9f37b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:51.920321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:51.940028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:52.340187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5a39429425478eba6d6a4b1fb9f37b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:52.443890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5a39429425478eba6d6a4b1fb9f37b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:52.445235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5a39429425478eba6d6a4b1fb9f37b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:52.446042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5a39429425478eba6d6a4b1fb9f37b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:52.457925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5a39429425478eba6d6a4b1fb9f37b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:52.493236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 813/1645] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:05:51 2022] DELETE /identity/v3/users/ee5a39429425478eba6d6a4b1fb9f37b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:52.495147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:52.495635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:52.496129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:52.520662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:52.522542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:52.656853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 833/1646] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:52.689748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:52.693346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:52.815716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dff0d0-69c6-4c7e-badb-b7a99a3aeec0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:52.820199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:52.821663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:52.821955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:52.822243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:52.833753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:52.835342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:52.854858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 814/1647] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:53.185938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:53.188622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:53.203521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5c4a-aa20-43f6-8c7f-6c3db3c503df None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:53.210100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:53.212325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:53.212325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:53.212325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] PATH_INFO: `/v3/projects/c3f26ce082af406f9e6b83899a4c3500` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:53.212890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f26ce082af406f9e6b83899a4c3500)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:53.215710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:53.375792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f26ce082af406f9e6b83899a4c3500', 'request_id': 'req-ee00b623-0cb5-429c-824e-30de0bd3d444'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:53.391943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f26ce082af406f9e6b83899a4c3500', 'request_id': 'req-ee00b623-0cb5-429c-824e-30de0bd3d444'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:53.395029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:53.469774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f26ce082af406f9e6b83899a4c3500', 'request_id': 'req-ee00b623-0cb5-429c-824e-30de0bd3d444'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:53.487256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] The token cache is being invalidate because project c3f26ce082af406f9e6b83899a4c3500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:05:53.487256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:53.495023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:53.496741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 834/1648] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:05:53 2022] DELETE /identity/v3/projects/c3f26ce082af406f9e6b83899a4c3500 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:53.501048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:53.516287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b1951-e214-4e97-a98f-7ba192906017 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:53.626759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:53.627190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:53.627465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:53.627748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] PATH_INFO: `/v3/users/6d2d259b701b4ab3857a904dc4864e57` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:53.633160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2d259b701b4ab3857a904dc4864e57)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:53.635131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:53.861619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:53.890408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2d259b701b4ab3857a904dc4864e57'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.008036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2d259b701b4ab3857a904dc4864e57'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.008036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2d259b701b4ab3857a904dc4864e57'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.008036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2d259b701b4ab3857a904dc4864e57'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.021040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2d259b701b4ab3857a904dc4864e57'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.061007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 815/1649] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:05:53 2022] DELETE /identity/v3/users/6d2d259b701b4ab3857a904dc4864e57 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:54.330489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:54.332067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:54.354672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b623-0cb5-429c-824e-30de0bd3d444 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:54.478738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:54.479472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:54.480519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:54.481038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] PATH_INFO: `/v3/projects/e569a1f8ad2f4d8f83e36847dd60fbe8` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:54.482554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e569a1f8ad2f4d8f83e36847dd60fbe8)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:54.485078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:54.655791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e569a1f8ad2f4d8f83e36847dd60fbe8', 'request_id': 'req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.671668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e569a1f8ad2f4d8f83e36847dd60fbe8', 'request_id': 'req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.786992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e569a1f8ad2f4d8f83e36847dd60fbe8', 'request_id': 'req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.797575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:54.799900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:54.806331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] The token cache is being invalidate because project e569a1f8ad2f4d8f83e36847dd60fbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:05:54.806636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.808778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:54.811382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 835/1650] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:05:54 2022] DELETE /identity/v3/projects/e569a1f8ad2f4d8f83e36847dd60fbe8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:54.825123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:54.828694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f98954-f7e8-4b59-ac19-2b582c9ca5fb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:54.832291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:54.963829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:54.965128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:54.965422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:54.965707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] PATH_INFO: `/v3/projects/90ad8c3e79c04eecb5957c88653d234a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:54.970116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ad8c3e79c04eecb5957c88653d234a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:54.973234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 11:05:54.973234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 15 11:05:54.973234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: Sep 15 11:05:54.977616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:55.066114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2206-e2ae-4ca1-abb0-13cef2a069dd admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:55.109376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:55.112478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:55.116887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:55.122431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] PATH_INFO: `/v3/users/e48c2108eae847bfb707a9efb09a3922` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:55.126469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48c2108eae847bfb707a9efb09a3922)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:55.130542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:55.253522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ad8c3e79c04eecb5957c88653d234a', 'request_id': 'req-ce599d5e-399a-45c4-93f8-f5e866c9fb44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.294040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ad8c3e79c04eecb5957c88653d234a', 'request_id': 'req-ce599d5e-399a-45c4-93f8-f5e866c9fb44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.294144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:55.398666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ad8c3e79c04eecb5957c88653d234a', 'request_id': 'req-ce599d5e-399a-45c4-93f8-f5e866c9fb44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.411486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48c2108eae847bfb707a9efb09a3922'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.420937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] The token cache is being invalidate because project 90ad8c3e79c04eecb5957c88653d234a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:05:55.421377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.423223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce599d5e-399a-45c4-93f8-f5e866c9fb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.427186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 816/1651] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:05:54 2022] DELETE /identity/v3/projects/90ad8c3e79c04eecb5957c88653d234a => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:55.434476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:55.436480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:55.436480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:55.483902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48c2108eae847bfb707a9efb09a3922'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.484849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48c2108eae847bfb707a9efb09a3922'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.485640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48c2108eae847bfb707a9efb09a3922'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.496956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3895a5d8-54a5-4411-978e-95ae29a60fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48c2108eae847bfb707a9efb09a3922'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:55.517564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:55.527070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:55.536174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 836/1652] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:05:54 2022] DELETE /identity/v3/users/e48c2108eae847bfb707a9efb09a3922 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:55.751053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:55.811434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 817/1653] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:55.820795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:55.821650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:55.822109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:55.851861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:55.854336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:56.055105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 837/1654] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:56.059608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:56.092127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914183b-2b0f-4706-8d42-dd25304a2f79 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:56.103232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:56.104067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:56.104647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:56.112207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:56.113379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:56.113894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:56.115766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:56.169818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 818/1655] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:56.175795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:56.234338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba370c7-e968-49bf-86f1-32aee1faae6c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:56.243849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:56.244124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:56.244546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:56.244947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:56.245751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:56.248119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:56.427252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 838/1656] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:56 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:56.432774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:56.450033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655b1f-8f26-4cb0-b566-f529a3e61ab7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:56.637144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:56.637939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:56.638230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:56.638510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:56.639164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:56.641244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:56.782723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 819/1657] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:56 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:56.787446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:56.813808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79177c-2b9e-4a8c-973e-c8c3d9a47883 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:56.831779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:56.835579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:56.836509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:56.839820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:56.839820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:56.842893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:56.885163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 839/1658] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:56.892566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:56.912198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc26c9d-fcec-49ef-a942-10fb4ff25490 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:56.920054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a96e7-08e2-42ec-95cf-7fe25802a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:56.921057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a96e7-08e2-42ec-95cf-7fe25802a70c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:56.921774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a96e7-08e2-42ec-95cf-7fe25802a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:56.922554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a96e7-08e2-42ec-95cf-7fe25802a70c admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:56.923915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a96e7-08e2-42ec-95cf-7fe25802a70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:56.926341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a96e7-08e2-42ec-95cf-7fe25802a70c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:56.965185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 820/1659] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:56.969521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:56.993962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1640e97-77ac-440a-a3f3-49d4d78093a9 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:57.004806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:57.007747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:57.008275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:57.009593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] PATH_INFO: `/v3/projects/3878e5528f194a86ac0a9a81b0c01637/users/2a5f0f0a8ce0458485fe99a1958b851f/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:57.041901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3878e5528f194a86ac0a9a81b0c01637, user_id=2a5f0f0a8ce0458485fe99a1958b851f, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:57.047424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:57.182229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 840/1660] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:56 2022] PUT /identity/v3/projects/3878e5528f194a86ac0a9a81b0c01637/users/2a5f0f0a8ce0458485fe99a1958b851f/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:57.196170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:57.197767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:57.201232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:57.270064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] MFA Rules not processed for user `2a5f0f0a8ce0458485fe99a1958b851f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:57.272846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:57.464435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 821/1661] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:57.465732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:57.566067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:57.626453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20a8ac-6f71-48d6-ad3f-33f45b439aeb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:57.632134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:57.632850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:57.633132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:57.633410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:57.634061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:57.636156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:57.749602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:57.751844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:57.772723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e17f-eb4a-40ae-895b-c279578ce415 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:57.772909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 841/1662] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:57 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:57.776666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:57.886248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:57.941961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:57.945533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:57.945815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:57.946092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] PATH_INFO: `/v3/projects/3101ded2edcf40c89734afd9b55deec6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:57.956907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3101ded2edcf40c89734afd9b55deec6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:57.956907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:57.958408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e8e0-e717-4808-9e1e-419981d48d4d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:57.973301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:57.974419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:57.974419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:57.976031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:57.977346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:57.981152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.102683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 842/1663] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:57 2022] POST /identity/v3/users => generated 300 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:05:58.103885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:58.166924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269534-5ba9-42c9-b1bb-2fe28926e15d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:58.191016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3101ded2edcf40c89734afd9b55deec6', 'request_id': 'req-445902da-e82a-4390-9c5c-8c49dedd7306'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:58.205902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3101ded2edcf40c89734afd9b55deec6', 'request_id': 'req-445902da-e82a-4390-9c5c-8c49dedd7306'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:58.303643 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3101ded2edcf40c89734afd9b55deec6', 'request_id': 'req-445902da-e82a-4390-9c5c-8c49dedd7306'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:58.327174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] The token cache is being invalidate because project 3101ded2edcf40c89734afd9b55deec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:05:58.334305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:58.338280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-445902da-e82a-4390-9c5c-8c49dedd7306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:05:58.344676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:58.345796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.346629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.346978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.348272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:58.355839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 822/1664] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:05:57 2022] DELETE /identity/v3/projects/3101ded2edcf40c89734afd9b55deec6 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:05:58.355972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.357800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04fb6-e5c2-47f2-8a5b-51b5e3db3c7c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.358097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04fb6-e5c2-47f2-8a5b-51b5e3db3c7c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.358629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04fb6-e5c2-47f2-8a5b-51b5e3db3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.384500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 843/1665] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:58.387788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:58.392281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:58.425425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03873f4-201b-40d8-9e26-dc5de0d15776 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:58.428760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cab04fb6-e5c2-47f2-8a5b-51b5e3db3c7c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:58.430269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cab04fb6-e5c2-47f2-8a5b-51b5e3db3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:58.438080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:58.439543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.439928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.440303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] PATH_INFO: `/v3/projects/9bb46b71f41a40059ede743bb88f37ab/users/300560e2a2bd4b10b23dc8fd6386ca60/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.457942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 823/1666] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:58.459800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.461181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.461545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.472466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb46b71f41a40059ede743bb88f37ab, user_id=300560e2a2bd4b10b23dc8fd6386ca60, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:58.472466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.504652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:58.507454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:58.528930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 824/1667] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:58.534228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:58.545568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea0b71-64be-4f90-a425-0374ed36221c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:58.557051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:58.558223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.558223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.566626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.566626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:05:58.566626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:58.566626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.597454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 844/1668] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:58 2022] PUT /identity/v3/projects/9bb46b71f41a40059ede743bb88f37ab/users/300560e2a2bd4b10b23dc8fd6386ca60/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:58.600384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:58.606783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 825/1669] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:05:58.608221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:58.650646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c395-8af9-4d31-bec3-8ddf757a8a35 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:58.776733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c09aad-5fd1-49ae-a24b-720982916a51 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:58.806853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:58.809980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.809980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.811085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.817901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:58.824459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.828955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:58.830345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.830448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:58.832081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.832970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.835759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:58.842963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.874631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 845/1670] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:58.877126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:58.910766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f190f-7fc5-4a55-b708-49b196d71e65 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:58.922640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b3918-131c-4df3-8c27-84badbabc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:58.923652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b3918-131c-4df3-8c27-84badbabc4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.924667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b3918-131c-4df3-8c27-84badbabc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.925218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b3918-131c-4df3-8c27-84badbabc4f4 admin admin] PATH_INFO: `/v3/projects/9bb46b71f41a40059ede743bb88f37ab/users/300560e2a2bd4b10b23dc8fd6386ca60/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:58.930126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b3918-131c-4df3-8c27-84badbabc4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb46b71f41a40059ede743bb88f37ab, user_id=300560e2a2bd4b10b23dc8fd6386ca60, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:58.933297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b3918-131c-4df3-8c27-84badbabc4f4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:58.958752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 846/1671] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:58 2022] PUT /identity/v3/projects/9bb46b71f41a40059ede743bb88f37ab/users/300560e2a2bd4b10b23dc8fd6386ca60/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:58.961664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:58.962154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:58.962533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.008786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 826/1672] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:05:58 2022] POST /identity/v3/projects => generated 385 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:59.010729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:59.052797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] MFA Rules not processed for user `300560e2a2bd4b10b23dc8fd6386ca60`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:05:59.057563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:59.134805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:59.282350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8afe50-71f0-43d8-8919-45866f845fae admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:59.304158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:59.306720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.308852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.310747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.311957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:59.321749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:59.369660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 847/1673] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:05:59.382685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:59.392459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:05:59.487533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 827/1674] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:05:59 2022] POST /identity/v3/users => generated 293 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:05:59.492531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:59.523011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c89c7-33cd-42db-93be-a8de1f3cca01 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:59.524534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657a4e9-c32d-438d-83a2-9e214079a653 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:59.529835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:59.530808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.531388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.531874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.536149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:59.536997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.538931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.539354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.540094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:59.545271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:59.547414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:59.547523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:59.559392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 848/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:05:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:05:59.570169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:59.583573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 828/1676] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:05:59.632414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd670b-e669-4bbc-8fc4-b7c84d299a18 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:59.658165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:59.659225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.659225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.659435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.660128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:59.661844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:59.675809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:59.689935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375b002-bfae-4659-9d83-f732f58aad36 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:59.710626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:59.719562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.719562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.719562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] PATH_INFO: `/v3/users/2a5f0f0a8ce0458485fe99a1958b851f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.719562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5f0f0a8ce0458485fe99a1958b851f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:59.721215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:59.731677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 849/1677] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:05:59.732470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:05:59.768358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986237f-87ac-47db-b99d-03eb382cf183 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:05:59.801245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e1733-0c89-446e-a0f5-3098bfdb694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:05:59.802744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e1733-0c89-446e-a0f5-3098bfdb694f admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.802744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e1733-0c89-446e-a0f5-3098bfdb694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.802744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e1733-0c89-446e-a0f5-3098bfdb694f admin admin] PATH_INFO: `/v3/projects/0b7df5b54dcb46d49d995135629d372b/users/1a43915fbbb548ceb9714c2d0d1716fb/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:05:59.836813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e1733-0c89-446e-a0f5-3098bfdb694f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7df5b54dcb46d49d995135629d372b, user_id=1a43915fbbb548ceb9714c2d0d1716fb, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:05:59.842474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e1733-0c89-446e-a0f5-3098bfdb694f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:05:59.941312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:05:59.950629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 850/1678] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:05:59 2022] PUT /identity/v3/projects/0b7df5b54dcb46d49d995135629d372b/users/1a43915fbbb548ceb9714c2d0d1716fb/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:05:59.961520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:05:59.962663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:05:59.963197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:00.050589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] MFA Rules not processed for user `1a43915fbbb548ceb9714c2d0d1716fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:00.063627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:00.073022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5f0f0a8ce0458485fe99a1958b851f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:00.163601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5f0f0a8ce0458485fe99a1958b851f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:00.164667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5f0f0a8ce0458485fe99a1958b851f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:00.165411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5f0f0a8ce0458485fe99a1958b851f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:00.185112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a8d4a0d4-760f-4f74-a3fe-79eb0c36199c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5f0f0a8ce0458485fe99a1958b851f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:00.247209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 829/1679] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:05:59 2022] DELETE /identity/v3/users/2a5f0f0a8ce0458485fe99a1958b851f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:00.265432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:00.266821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:00.267117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:00.286156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 851/1680] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:00.290617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:00.295073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:00.369116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:00.373688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:00.455848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b77543-e373-47a4-9e65-1bc9a307fb05 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:00.557290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 830/1681] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:00.624592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:00.624592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:00.625874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:00.625874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:00.625874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:00.625874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:00.626430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:00.626430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:00.703317 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604275-e6bb-48f0-9b5f-9c684c561808 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:00.709590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:00.711651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:00.712149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:00.712514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:00.723781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:00.726484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:00.744892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 831/1682] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:02.277661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 852/1683] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:00 2022] POST /identity/v3/projects => generated 387 bytes in 1987 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:02.281384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:02.293328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a2b8-d6e1-45d3-87cf-2a184c985c40 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:02.401488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:02.402025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:02.402313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:02.402651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:02.403299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:02.406712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:02.533215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 832/1684] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:02 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:02.536850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:02.552292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eae7dd-c5e6-47b7-81ff-0eacec992f6c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:02.568027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:02.568795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:02.569060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:02.569508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:02.570341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:02.572446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:02.600384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 853/1685] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:02.602871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:02.630844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74d5a1-3a6c-4154-ab43-810c7ad62d61 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:02.654775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:02.655473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:02.655755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:02.656033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] PATH_INFO: `/v3/projects/034e3b4f2fe54047bf9a6908e9a9b68f/users/6c414b4d591849e7bd4bb6fd08214f10/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:02.699356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=034e3b4f2fe54047bf9a6908e9a9b68f, user_id=6c414b4d591849e7bd4bb6fd08214f10, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:02.706154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:02.717391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:02.908973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 833/1686] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:02 2022] PUT /identity/v3/projects/034e3b4f2fe54047bf9a6908e9a9b68f/users/6c414b4d591849e7bd4bb6fd08214f10/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:02.913797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:02.933070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104f131-e628-4dd2-bb96-8447b91406bb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:03.092294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:03.106215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7dd1a-6e4b-4719-961b-5cdf73522af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:03.109186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7dd1a-6e4b-4719-961b-5cdf73522af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:03.110429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7dd1a-6e4b-4719-961b-5cdf73522af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:03.112001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7dd1a-6e4b-4719-961b-5cdf73522af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:03.113891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7dd1a-6e4b-4719-961b-5cdf73522af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:03.122029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7dd1a-6e4b-4719-961b-5cdf73522af1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:03.149837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 854/1687] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:03.154319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:03.174030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6677-98ad-4b26-98f7-29edc3974963 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:03.190309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:03.191016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:03.191303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:03.191585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] PATH_INFO: `/v3/projects/034e3b4f2fe54047bf9a6908e9a9b68f/users/6c414b4d591849e7bd4bb6fd08214f10/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:03.193775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=034e3b4f2fe54047bf9a6908e9a9b68f, user_id=6c414b4d591849e7bd4bb6fd08214f10, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:03.197367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:03.222340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 834/1688] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:03 2022] PUT /identity/v3/projects/034e3b4f2fe54047bf9a6908e9a9b68f/users/6c414b4d591849e7bd4bb6fd08214f10/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:03.232636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:03.232947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:03.233237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:03.289255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] MFA Rules not processed for user `6c414b4d591849e7bd4bb6fd08214f10`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:03.290760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:03.434328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 855/1689] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:03.451772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:03.453537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:03.563146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dc020-40c8-4155-9f7e-55582833f488 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:03.567652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:03.568271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:03.568635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:03.569496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:03.584997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:03.586453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:03.610944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 835/1690] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:03.690933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:03.837248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0eaaf-fc66-43bd-9924-0a5b6b622016 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:03.849808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:03.854145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:03.854600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:03.855092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] PATH_INFO: `/v3/users/1a43915fbbb548ceb9714c2d0d1716fb` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:03.857367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a43915fbbb548ceb9714c2d0d1716fb)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:03.860764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:04.135236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a43915fbbb548ceb9714c2d0d1716fb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.179463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:04.181284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:04.211261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d338-cc4b-4399-9a74-597a050a8c96 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:04.223066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:04.224012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:04.224520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:04.225507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] PATH_INFO: `/v3/users/800d839dac4b44a987aebdc4d1ef8e91` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:04.228001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800d839dac4b44a987aebdc4d1ef8e91)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:04.230356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:04.235615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a43915fbbb548ceb9714c2d0d1716fb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.238487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a43915fbbb548ceb9714c2d0d1716fb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.239880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a43915fbbb548ceb9714c2d0d1716fb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.268074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6267293-e651-468e-aba1-63d9ef81b3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a43915fbbb548ceb9714c2d0d1716fb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.315269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 856/1691] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:03 2022] DELETE /identity/v3/users/1a43915fbbb548ceb9714c2d0d1716fb => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:04.320698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:04.321839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:04.322342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:04.373782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:04.378498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:04.498729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800d839dac4b44a987aebdc4d1ef8e91'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.583358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800d839dac4b44a987aebdc4d1ef8e91'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.584049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800d839dac4b44a987aebdc4d1ef8e91'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.585466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800d839dac4b44a987aebdc4d1ef8e91'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.598604 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-19c4f3b2-9537-4995-84f1-01a0b371f481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800d839dac4b44a987aebdc4d1ef8e91'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:04.630180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 857/1692] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:04.635134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:04.642318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:04.654090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:04.670824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 836/1693] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:04 2022] DELETE /identity/v3/users/800d839dac4b44a987aebdc4d1ef8e91 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:04.676173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:04.680288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a565-9090-4541-8679-4abb46d35f88 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:04.680892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:04.682396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:04.754587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:04.755816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:04.906298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:04.913729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:04.922344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:04.922967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] PATH_INFO: `/v3/projects/3878e5528f194a86ac0a9a81b0c01637` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:04.924880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3878e5528f194a86ac0a9a81b0c01637)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:04.933710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:04.957988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:05.002692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 837/1694] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:05.003764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:05.016989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:05.149477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5294c5-1737-48d2-a545-30b72b107d37 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:05.170719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3878e5528f194a86ac0a9a81b0c01637', 'request_id': 'req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:05.216164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3878e5528f194a86ac0a9a81b0c01637', 'request_id': 'req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:05.265419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f35ffb-5d72-495e-a59a-1e2015875f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:05.266338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f35ffb-5d72-495e-a59a-1e2015875f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:05.266832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f35ffb-5d72-495e-a59a-1e2015875f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:05.267319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f35ffb-5d72-495e-a59a-1e2015875f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:05.320969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3878e5528f194a86ac0a9a81b0c01637', 'request_id': 'req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:05.341199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] The token cache is being invalidate because project 3878e5528f194a86ac0a9a81b0c01637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:05.341493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:05.344413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:05.354671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 858/1695] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:04 2022] DELETE /identity/v3/projects/3878e5528f194a86ac0a9a81b0c01637 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:05.360417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:05.360417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:05.390601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da7c96-f8fe-4f2b-a6bd-88ac35b2a26e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:05.402077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:05.403898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:05.404391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:05.404819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:05.410180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:05.411709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:05.440811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f35ffb-5d72-495e-a59a-1e2015875f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:05.442474 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f35ffb-5d72-495e-a59a-1e2015875f19 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:05.465800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 838/1696] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:05.467346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a57a-fc48-4dd6-b043-2163bae6fdea None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:05.472695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a57a-fc48-4dd6-b043-2163bae6fdea None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:05.473134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a57a-fc48-4dd6-b043-2163bae6fdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:05.539762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-69a5a57a-fc48-4dd6-b043-2163bae6fdea None None] MFA Rules not processed for user `0eac81d7fb9b4a58ae8023bfd5709d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:05.539762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-69a5a57a-fc48-4dd6-b043-2163bae6fdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:05.618005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:05.619498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:05.655541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 859/1697] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:05.657352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:05.660047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:05.700770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1049ff-92e4-4504-960c-243e99319e71 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:05.716100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:05.716806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:05.717089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:05.717366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] PATH_INFO: `/v3/users/300560e2a2bd4b10b23dc8fd6386ca60` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:05.720462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=300560e2a2bd4b10b23dc8fd6386ca60)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:05.727157 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:05.793603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 839/1698] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:05.797706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e267b3-375b-4169-96a3-7c94f2f45ee0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:05.798962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e267b3-375b-4169-96a3-7c94f2f45ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:05.799469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e267b3-375b-4169-96a3-7c94f2f45ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:05.872034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f6e267b3-375b-4169-96a3-7c94f2f45ee0 None None] MFA Rules not processed for user `5111139cdb444281b95871311f9c7f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:05.873515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f6e267b3-375b-4169-96a3-7c94f2f45ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.051282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 840/1699] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:06.051282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da02f10-8596-4469-af95-6e942f01dc83 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.051282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da02f10-8596-4469-af95-6e942f01dc83 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.051282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da02f10-8596-4469-af95-6e942f01dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.120832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300560e2a2bd4b10b23dc8fd6386ca60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:06.121290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6da02f10-8596-4469-af95-6e942f01dc83 None None] MFA Rules not processed for user `39133da0b7e049f09431c6e3d015f567`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:06.122852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6da02f10-8596-4469-af95-6e942f01dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.155026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:06.226358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300560e2a2bd4b10b23dc8fd6386ca60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:06.227317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300560e2a2bd4b10b23dc8fd6386ca60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:06.228221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300560e2a2bd4b10b23dc8fd6386ca60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:06.242137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2814a94-90a0-4313-86bf-a802df044ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300560e2a2bd4b10b23dc8fd6386ca60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:06.298959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 860/1700] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:05 2022] DELETE /identity/v3/users/300560e2a2bd4b10b23dc8fd6386ca60 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:06.300958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f91a4-e585-4c1a-984d-5e8ae1056a86 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.301236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f91a4-e585-4c1a-984d-5e8ae1056a86 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.305753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f91a4-e585-4c1a-984d-5e8ae1056a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.347349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 841/1701] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:06.350239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ea68-5d49-4aa9-ad8b-c759f1ac2b7a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.350793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ea68-5d49-4aa9-ad8b-c759f1ac2b7a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.351309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ea68-5d49-4aa9-ad8b-c759f1ac2b7a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.363659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 842/1702] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 15 11:06:06 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:06.367329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.367756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.368059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.377232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1c4f91a4-e585-4c1a-984d-5e8ae1056a86 None None] MFA Rules not processed for user `0eac81d7fb9b4a58ae8023bfd5709d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:06.388182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1c4f91a4-e585-4c1a-984d-5e8ae1056a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.489854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:06.491842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.571309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 861/1703] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:06.574659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59989a38-d0c8-4ba2-ab93-d12fc4fd43a9 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.575285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59989a38-d0c8-4ba2-ab93-d12fc4fd43a9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.576721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59989a38-d0c8-4ba2-ab93-d12fc4fd43a9 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.585184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 862/1704] 10.222.0.26 () {54 vars in 962 bytes} [Thu Sep 15 11:06:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:06.589030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.589478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.592516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.641943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:06.643975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.661547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 843/1705] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 15 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:06.666606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 863/1706] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Sep 15 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:06.667889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:06.675496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:06.690836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d042a-1bb4-4658-a94a-d6a89b8278c1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:06.694377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91da5c0-03d6-4c1e-83c1-800bca4b2e8b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:06.704033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:06.705032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.705250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:06.705501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.705876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.710521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:06.710885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:06.711174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:06.719601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.920831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:06.931804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:06.933798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:06.953031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:06.960024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87331837-2a46-45ab-953c-f53eff390e69 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:06.982356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 864/1707] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:06.984977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:06.989008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:06.995789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 844/1708] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:07.214570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:07.214851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:07.215282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:07.218425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d05d-c6a9-401d-8f3b-f7de83271a49 service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:07.224526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:07.228547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:07.229019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:07.229418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] PATH_INFO: `/v3/projects/12d50f3dbe3e4c8b945ce26e68437aa8` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:07.233173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d50f3dbe3e4c8b945ce26e68437aa8)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:07.238749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:07.289986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] MFA Rules not processed for user `0ea736407a9846e9899e10a8320e692a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:07.298611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:07.446254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d50f3dbe3e4c8b945ce26e68437aa8', 'request_id': 'req-7e117011-d5bb-4017-9a0e-127605644618'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:07.463208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d50f3dbe3e4c8b945ce26e68437aa8', 'request_id': 'req-7e117011-d5bb-4017-9a0e-127605644618'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:07.534560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d50f3dbe3e4c8b945ce26e68437aa8', 'request_id': 'req-7e117011-d5bb-4017-9a0e-127605644618'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:07.552025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] The token cache is being invalidate because project 12d50f3dbe3e4c8b945ce26e68437aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:07.552502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:07.555645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:07.564060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 865/1709] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:06 2022] DELETE /identity/v3/projects/12d50f3dbe3e4c8b945ce26e68437aa8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:07.565215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:07.568856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:07.569385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 845/1710] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:07.625135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:07.627107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:07.654607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0edb0-06ad-49e3-87f0-80f9618b8bf5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:07.710092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117011-d5bb-4017-9a0e-127605644618 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:07.727550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:07.728658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:07.729019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:07.729459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:07.729459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] PATH_INFO: `/v3/users/3278e53b48404e3493810711245cf7d7` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:07.731821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3278e53b48404e3493810711245cf7d7)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:07.737674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:07.798478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:07.799172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:07.799628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:07.800061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] PATH_INFO: `/v3/projects/9bb46b71f41a40059ede743bb88f37ab` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:07.804826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb46b71f41a40059ede743bb88f37ab)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:07.807496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:08.001574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3278e53b48404e3493810711245cf7d7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.013194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb46b71f41a40059ede743bb88f37ab', 'request_id': 'req-87d9be87-42c9-44c9-9a65-a9fc12fb3955'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.020648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb46b71f41a40059ede743bb88f37ab', 'request_id': 'req-87d9be87-42c9-44c9-9a65-a9fc12fb3955'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.141354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3278e53b48404e3493810711245cf7d7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.142687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3278e53b48404e3493810711245cf7d7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.143526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3278e53b48404e3493810711245cf7d7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.156782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3278e53b48404e3493810711245cf7d7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.194490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 866/1711] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:07 2022] DELETE /identity/v3/users/3278e53b48404e3493810711245cf7d7 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:08.206244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:08.208185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.229343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb46b71f41a40059ede743bb88f37ab', 'request_id': 'req-87d9be87-42c9-44c9-9a65-a9fc12fb3955'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.255671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] The token cache is being invalidate because project 9bb46b71f41a40059ede743bb88f37ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:08.256859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.258288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:08.267669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:08.277685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 846/1712] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:07 2022] DELETE /identity/v3/projects/9bb46b71f41a40059ede743bb88f37ab => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:08.277685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:08.278318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.414750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1089c-ccac-4c4a-ab26-d7f2169b3e5f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:08.450472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:08.451100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.451436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.451650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:08.458065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.506391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9be87-42c9-44c9-9a65-a9fc12fb3955 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:08.512519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:08.513383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.513790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.514150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:08.516659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.602500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:08.604274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:08.624194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 867/1713] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:08.628063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:08.660843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.753000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:08.762234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:08.768816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24462e80-265c-4e0e-9e5a-fabd17bf52cb service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:08.791257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 847/1714] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:08.793603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7f41-0024-419a-8ee8-0f5e93acb4df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.793603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7f41-0024-419a-8ee8-0f5e93acb4df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.793603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7f41-0024-419a-8ee8-0f5e93acb4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:08.851318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b93f7f41-0024-419a-8ee8-0f5e93acb4df None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:08.857519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b93f7f41-0024-419a-8ee8-0f5e93acb4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.875005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c354-38b0-4fd2-b1c7-fb437633d20b service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:08.877872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 848/1715] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:08.884571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008978-1596-4d53-965d-77f065fcb37e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.885182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008978-1596-4d53-965d-77f065fcb37e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.886234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008978-1596-4d53-965d-77f065fcb37e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:08.889750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:08.890720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 849/1716] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 15 11:06:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:08.892205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409348-d90d-4792-9894-135d644920c9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.892695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.898037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.898037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] PATH_INFO: `/v3/projects/0b7df5b54dcb46d49d995135629d372b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:08.898395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409348-d90d-4792-9894-135d644920c9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.898395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409348-d90d-4792-9894-135d644920c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:08.899245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7df5b54dcb46d49d995135629d372b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:08.909951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:08.946465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:08.954145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-31409348-d90d-4792-9894-135d644920c9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:08.961339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-31409348-d90d-4792-9894-135d644920c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:08.990655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 850/1717] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:08.991399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:08.992260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:08.993003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:09.060330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:09.069485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:09.098298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 851/1718] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:06:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:09.099483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:09.132480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281e35-cd10-4ca1-968a-f4af43ed9fff None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:09.149808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7df5b54dcb46d49d995135629d372b', 'request_id': 'req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.160083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7df5b54dcb46d49d995135629d372b', 'request_id': 'req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.260065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7df5b54dcb46d49d995135629d372b', 'request_id': 'req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.279593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] The token cache is being invalidate because project 0b7df5b54dcb46d49d995135629d372b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:09.280214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.281215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.288552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 868/1719] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:08 2022] DELETE /identity/v3/projects/0b7df5b54dcb46d49d995135629d372b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:09.290036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:09.292285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:09.307030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:09.310126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:09.311767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:09.312985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:09.314927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:09.316786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:09.322043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:09.373787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 852/1720] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:09.374727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:09.380381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:09.415225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14737290-41c6-4319-a764-5b64dd774596 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:09.430785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:09.431455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:09.431739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:09.432015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] PATH_INFO: `/v3/users/6c414b4d591849e7bd4bb6fd08214f10` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:09.435289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c414b4d591849e7bd4bb6fd08214f10)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:09.437593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:09.467103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5a3ce-1ace-41b0-9283-960c66a7d3d1 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:09.472289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:09.473100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:09.473473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:09.473897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:09.478160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:09.633462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:09.634293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:09.651554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 869/1721] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:09.653060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:09.656016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:09.690959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38929de-ab3d-45c0-a0c1-af1288ddb6d6 service glance] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:09.713615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:09.724934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:09.724934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:09.724934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:09.725258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c414b4d591849e7bd4bb6fd08214f10'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.725373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:09.732939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:09.830663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c414b4d591849e7bd4bb6fd08214f10'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.831310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c414b4d591849e7bd4bb6fd08214f10'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.831930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c414b4d591849e7bd4bb6fd08214f10'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.849377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c414b4d591849e7bd4bb6fd08214f10'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:09.895732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 870/1722] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:09 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:09.898107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 853/1723] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:09 2022] DELETE /identity/v3/users/6c414b4d591849e7bd4bb6fd08214f10 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:09.903778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:09.905686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:10.015479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f85614-284e-4553-ba20-3502a6c88479 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:10.167562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:10.168271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:10.168582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:10.169030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:10.169929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:10.171877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:10.307426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 871/1724] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:09 2022] POST /identity/v3/users => generated 284 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:06:10.317910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:10.358582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a45d46-76e1-41ce-a0e3-8b1581a9ca2c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:10.377035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:10.378240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:10.388263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:10.391308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:10.391308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:10.402702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:10.429004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 854/1725] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:10.431636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:10.440640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703826ba-9161-4278-a7da-6cd0c1349458 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:10.456129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:10.458881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:10.458881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:10.458881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:10.458881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:10.462237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:10.486861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 872/1726] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:10.488816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:10.512633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003618e-d65c-4bac-8b8b-a1551ce7f08b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:10.535356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12681067-60a6-4595-8385-e95e363dea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:10.539363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12681067-60a6-4595-8385-e95e363dea0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:10.540530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12681067-60a6-4595-8385-e95e363dea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:10.540530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12681067-60a6-4595-8385-e95e363dea0c admin admin] PATH_INFO: `/v3/projects/dc11718acb2a40e997122d6f12969422/users/5cb2e84af32347f4b4a28078b27e0339/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:10.570210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:10.581668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12681067-60a6-4595-8385-e95e363dea0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc11718acb2a40e997122d6f12969422, user_id=5cb2e84af32347f4b4a28078b27e0339, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:10.585211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12681067-60a6-4595-8385-e95e363dea0c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:10.619040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:10.620868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:10.645131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfb9ac-6283-4e72-8768-95047e0f73e5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:10.659425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:10.660676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:10.660676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:10.660676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] PATH_INFO: `/v3/projects/fac83fa3508e4ae3a345e7b814ea38c1` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:10.661855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac83fa3508e4ae3a345e7b814ea38c1)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:10.664972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:10.726497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 855/1727] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:10 2022] PUT /identity/v3/projects/dc11718acb2a40e997122d6f12969422/users/5cb2e84af32347f4b4a28078b27e0339/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:10.729052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:10.730025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:10.730468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:10.769160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] MFA Rules not processed for user `5cb2e84af32347f4b4a28078b27e0339`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:10.770911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:10.801437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:10.831628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac83fa3508e4ae3a345e7b814ea38c1', 'request_id': 'req-eae797fb-253d-4567-b5a5-39618f961ef1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:10.839826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac83fa3508e4ae3a345e7b814ea38c1', 'request_id': 'req-eae797fb-253d-4567-b5a5-39618f961ef1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:10.914611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 856/1728] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:10.917769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:10.922937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:10.950172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac83fa3508e4ae3a345e7b814ea38c1', 'request_id': 'req-eae797fb-253d-4567-b5a5-39618f961ef1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:10.980663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] The token cache is being invalidate because project fac83fa3508e4ae3a345e7b814ea38c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:10.981415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:10.983897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-eae797fb-253d-4567-b5a5-39618f961ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:10.988101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 873/1729] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:10 2022] DELETE /identity/v3/projects/fac83fa3508e4ae3a345e7b814ea38c1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:11.000182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621d781-849d-4043-bb09-3863adea7f60 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.001368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621d781-849d-4043-bb09-3863adea7f60 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.004590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621d781-849d-4043-bb09-3863adea7f60 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.007785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 874/1730] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 15 11:06:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:11.022891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621d781-849d-4043-bb09-3863adea7f60 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:11.032421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25ce09-2367-4aac-8c2b-37625081b29c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:11.043621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4621d781-849d-4043-bb09-3863adea7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.176417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:11.177302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.177593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.178000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] PATH_INFO: `/v3/projects/034e3b4f2fe54047bf9a6908e9a9b68f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.180620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=034e3b4f2fe54047bf9a6908e9a9b68f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:11.182990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:11.229985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621d781-849d-4043-bb09-3863adea7f60 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:11.237119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb9211-dfd3-4620-98d6-c7d562c5b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:11.237765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9211-dfd3-4620-98d6-c7d562c5b38e admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.238047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9211-dfd3-4620-98d6-c7d562c5b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.238322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9211-dfd3-4620-98d6-c7d562c5b38e admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.242152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb9211-dfd3-4620-98d6-c7d562c5b38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:11.244269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb9211-dfd3-4620-98d6-c7d562c5b38e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:11.351779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034e3b4f2fe54047bf9a6908e9a9b68f', 'request_id': 'req-915a14bb-ad12-489f-9249-08143e8ba0cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:11.360632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 875/1731] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/projects => generated 365 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:11.362876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.364141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034e3b4f2fe54047bf9a6908e9a9b68f', 'request_id': 'req-915a14bb-ad12-489f-9249-08143e8ba0cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:11.364685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.365973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.421145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:11.425340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.466417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034e3b4f2fe54047bf9a6908e9a9b68f', 'request_id': 'req-915a14bb-ad12-489f-9249-08143e8ba0cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:11.486179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] The token cache is being invalidate because project 034e3b4f2fe54047bf9a6908e9a9b68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:11.486179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:11.486865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-915a14bb-ad12-489f-9249-08143e8ba0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:11.493650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 857/1732] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:10 2022] DELETE /identity/v3/projects/034e3b4f2fe54047bf9a6908e9a9b68f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:11.495348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74cec5-a95c-4ef0-8ecc-77b2c92518a4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.495694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74cec5-a95c-4ef0-8ecc-77b2c92518a4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.496067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74cec5-a95c-4ef0-8ecc-77b2c92518a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.562716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 876/1733] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:11.563861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:11.564901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.573021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8f74cec5-a95c-4ef0-8ecc-77b2c92518a4 None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:11.575894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f74cec5-a95c-4ef0-8ecc-77b2c92518a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.597341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546d9bc-3d2a-42aa-a950-9fe4f0a8da86 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:11.611403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deea7c9-c37e-4538-9951-1c2128b15ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:11.612506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deea7c9-c37e-4538-9951-1c2128b15ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.612506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deea7c9-c37e-4538-9951-1c2128b15ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.612707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deea7c9-c37e-4538-9951-1c2128b15ebd admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.613284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deea7c9-c37e-4538-9951-1c2128b15ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:11.615752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deea7c9-c37e-4538-9951-1c2128b15ebd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:11.661895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 858/1734] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:11.664088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.664775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.665259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.709358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 877/1735] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:11.709358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd70c-799e-4c7b-afea-2bff56df1c14 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.709358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd70c-799e-4c7b-afea-2bff56df1c14 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.709358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd70c-799e-4c7b-afea-2bff56df1c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.719630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] MFA Rules not processed for user `d8d1da88813d49cf9abb7b626a94259e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:11.727225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.753414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b4cfd70c-799e-4c7b-afea-2bff56df1c14 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:11.753414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b4cfd70c-799e-4c7b-afea-2bff56df1c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.778971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 878/1736] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:11.778971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.778971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.778971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.817034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:11.817034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.831484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 879/1737] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:11.833030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:11.835905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:11.848429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d49ddc-370a-48e0-90de-9606c5064f2c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:11.860191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9239-189c-4a24-8180-458b8a4b93ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:11.861513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9239-189c-4a24-8180-458b8a4b93ca service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.864992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9239-189c-4a24-8180-458b8a4b93ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.866181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9239-189c-4a24-8180-458b8a4b93ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.885847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 859/1738] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:11.904446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:11.916444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e9239-189c-4a24-8180-458b8a4b93ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:11.918563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e9239-189c-4a24-8180-458b8a4b93ca service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:11.929422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fbe60-1d32-4806-9f35-9a02553ad33b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:11.935801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 880/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:11.938074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f12be-780a-49d0-bc6b-48caac2881ef None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.940036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:11.940577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f12be-780a-49d0-bc6b-48caac2881ef None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.941024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f12be-780a-49d0-bc6b-48caac2881ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.945597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:11.945597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:11.945597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:11.945597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:11.948192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:11.985699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 860/1740] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:11.999988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.001492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:12.023260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5d6f12be-780a-49d0-bc6b-48caac2881ef None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:12.028173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5d6f12be-780a-49d0-bc6b-48caac2881ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:12.055450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 881/1741] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:12.056274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ee85f-0754-4bdd-b386-18b2efc29451 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.057353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.057737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.058120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.072844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.073677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.074113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.074625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.075774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:12.076318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.080582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.111370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] MFA Rules not processed for user `d8d1da88813d49cf9abb7b626a94259e`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:12.114230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:12.129297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 861/1742] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:12.130833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.152511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 882/1743] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:12.154231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.174248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9308-901e-4e23-9f5a-27a3e2ed0ac9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.185746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8650a7e-3ef5-49c0-aaf1-e8162a749978 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.191687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.193417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.193877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.195141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] PATH_INFO: `/v3/projects/51aee0803be74f749c2e6e58cbd05f19/users/710c1a055e1f4710a336b35c8a37eeaa/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.204033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.205342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.205793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.206258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.207521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:12.207960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.216700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.252052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51aee0803be74f749c2e6e58cbd05f19, user_id=710c1a055e1f4710a336b35c8a37eeaa, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.258185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.264864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 883/1744] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:12.266526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.283455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c2db-8064-4f90-a4ba-a3cd3c65ab29 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.290769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.291536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.291950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.292336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.293129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.295189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.398830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 862/1745] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:12 2022] PUT /identity/v3/projects/51aee0803be74f749c2e6e58cbd05f19/users/710c1a055e1f4710a336b35c8a37eeaa/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:12.402583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.402828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 884/1746] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:12 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:12.403721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.414584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:12.479095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:12.559982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004bff0-58cd-4d5b-9fed-933c58485d3a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.577089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.579090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.580565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.580848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.581783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.585919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ccb7f-1d5e-45a3-9258-c70fa7aa2749 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.587180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.754975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 885/1747] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:12 2022] POST /identity/v3/projects => generated 383 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:12.756469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.766678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.767487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.767770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.768048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.883594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd908a0a-07ef-453c-ab26-bd903929cd6b admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.895292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.899761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.900518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.900996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.901332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.901696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.902659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.905773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.918113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 863/1748] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:12.919010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.923263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 886/1749] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:12.923975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:12.933876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab3873-c398-4e8f-b776-785302ffa537 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.939405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.940296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.940609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.946657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.946657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.946657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:12.971322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd99b-4815-43b5-a74d-d5453d693e87 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:12.980905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19db18-222b-47fa-8705-dced7c674297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:12.981971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19db18-222b-47fa-8705-dced7c674297 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:12.982267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19db18-222b-47fa-8705-dced7c674297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:12.982543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19db18-222b-47fa-8705-dced7c674297 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:12.983450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19db18-222b-47fa-8705-dced7c674297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:12.985531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19db18-222b-47fa-8705-dced7c674297 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.049034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 864/1750] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:12 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:13.049034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.071783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5389e6-fc11-4b70-9d23-5513daa939f7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:13.077675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd79e-9fbe-4c0b-aa50-c683bb5033cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:13.079212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd79e-9fbe-4c0b-aa50-c683bb5033cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.079212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd79e-9fbe-4c0b-aa50-c683bb5033cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.079212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd79e-9fbe-4c0b-aa50-c683bb5033cc admin admin] PATH_INFO: `/v3/projects/51aee0803be74f749c2e6e58cbd05f19/users/710c1a055e1f4710a336b35c8a37eeaa/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.082950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd79e-9fbe-4c0b-aa50-c683bb5033cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51aee0803be74f749c2e6e58cbd05f19, user_id=710c1a055e1f4710a336b35c8a37eeaa, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:13.086336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd79e-9fbe-4c0b-aa50-c683bb5033cc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.120360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 865/1751] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:13 2022] PUT /identity/v3/projects/51aee0803be74f749c2e6e58cbd05f19/users/710c1a055e1f4710a336b35c8a37eeaa/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:13.120360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd1fd-6125-4a99-8785-78656384497f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.120360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd1fd-6125-4a99-8785-78656384497f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.120360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd1fd-6125-4a99-8785-78656384497f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.120360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 866/1752] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 15 11:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:13.120360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdd1fd-6125-4a99-8785-78656384497f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.144175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 887/1753] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:12 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:13.145664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.146036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.146840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.227284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] MFA Rules not processed for user `710c1a055e1f4710a336b35c8a37eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:13.228572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:13.247369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdd1fd-6125-4a99-8785-78656384497f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:13.255181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66d332-c953-4bf2-9d83-9e262b32aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:13.262420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d332-c953-4bf2-9d83-9e262b32aa80 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.262420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d332-c953-4bf2-9d83-9e262b32aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.262420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66d332-c953-4bf2-9d83-9e262b32aa80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.263065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66d332-c953-4bf2-9d83-9e262b32aa80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:13.265218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66d332-c953-4bf2-9d83-9e262b32aa80 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.285396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 867/1754] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:13.291895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.292701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.293118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.388720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:13.388720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:13.414100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 888/1755] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:13.415281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.453936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f513f9-2d3a-4ffa-a7fc-241f68c9170a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:13.472095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb2bd2-c184-4f12-80b0-c894ac5d82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:13.475000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb2bd2-c184-4f12-80b0-c894ac5d82fa admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.475000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb2bd2-c184-4f12-80b0-c894ac5d82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.478847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb2bd2-c184-4f12-80b0-c894ac5d82fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.480705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb2bd2-c184-4f12-80b0-c894ac5d82fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:13.486422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb2bd2-c184-4f12-80b0-c894ac5d82fa admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.517289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 889/1756] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:13.518916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.522279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.522681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.575450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 868/1757] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:13.576927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.585370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] MFA Rules not processed for user `5111139cdb444281b95871311f9c7f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:13.586484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:13.602188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e65b8-2098-4bc9-b6c5-47151323b86d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:13.617759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:13.619002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.621336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.621336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.622472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:13.624626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.650039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 869/1758] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:13.650039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.655433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:13.697942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 890/1759] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:13.699476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.701418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:13.758837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9eba6-cc84-4f9c-adac-96dcf837229b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:13.764449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:13.770669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.770669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.770669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.780154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:13.782354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.821721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 870/1760] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:13.821721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.849221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883f79-1eea-4b9d-97a0-650431cbdeb9 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:13.863498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:13.864541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:13.864831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:13.865846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:13.867810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:13.871406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:13.900704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:13.903564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 871/1761] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:13.904383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:13.906722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:13.992787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b44e-f575-4418-b678-59fcbde70a3a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:14.007136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:14.008135 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.008568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.008941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.011051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:14.055045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:14.059080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:14.089123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 891/1762] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:14.089917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9163f-2eef-44f6-807f-ee4f82218d4a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:14.091403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:14.105944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ae58-948d-4468-b520-0e846931960e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:14.116535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ae58-948d-4468-b520-0e846931960e service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.116535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ae58-948d-4468-b520-0e846931960e service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.116535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035ae58-948d-4468-b520-0e846931960e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.133886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ae58-948d-4468-b520-0e846931960e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:14.135476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035ae58-948d-4468-b520-0e846931960e service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:14.136496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a656-2bfb-459f-bcb3-3104a967b622 service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:14.150817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:14.151845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.152351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.152834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] PATH_INFO: `/v3/projects/d68db952ee0c4c87bb9234aa09dc75c1/users/b47435496dcc4f93a22a141d8f9776d9/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.178829 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 872/1763] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:14.179793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ae58-948d-4468-b520-0e846931960e service glance] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:14.197108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68db952ee0c4c87bb9234aa09dc75c1, user_id=b47435496dcc4f93a22a141d8f9776d9, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:14.200131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:14.210042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035ae58-948d-4468-b520-0e846931960e service glance] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:14.217060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f5df9-bed6-43ee-bbe3-5bbcd7a801e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:14.217789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f5df9-bed6-43ee-bbe3-5bbcd7a801e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.219162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f5df9-bed6-43ee-bbe3-5bbcd7a801e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.219469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f5df9-bed6-43ee-bbe3-5bbcd7a801e9 admin admin] PATH_INFO: `/v3/projects/e8f67477bf3144bd96f9c4145823e3c7/users/e418dab8fcbc4eb09563b31f0f645e22/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.248009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f5df9-bed6-43ee-bbe3-5bbcd7a801e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f67477bf3144bd96f9c4145823e3c7, user_id=e418dab8fcbc4eb09563b31f0f645e22, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:14.253743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f5df9-bed6-43ee-bbe3-5bbcd7a801e9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:14.292289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 892/1764] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:14 2022] PUT /identity/v3/projects/d68db952ee0c4c87bb9234aa09dc75c1/users/b47435496dcc4f93a22a141d8f9776d9/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:14.292878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:14.359592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 873/1765] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:14 2022] PUT /identity/v3/projects/e8f67477bf3144bd96f9c4145823e3c7/users/e418dab8fcbc4eb09563b31f0f645e22/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:14.359592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c1a0-df78-4554-b055-c2b2a3134bdd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.359592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c1a0-df78-4554-b055-c2b2a3134bdd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.359592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c1a0-df78-4554-b055-c2b2a3134bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.425383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:14.450716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b17f60-f49e-4301-b668-787be08fd5c3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:14.479380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b9a8c1a0-df78-4554-b055-c2b2a3134bdd None None] MFA Rules not processed for user `b47435496dcc4f93a22a141d8f9776d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:14.481481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b9a8c1a0-df78-4554-b055-c2b2a3134bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:14.571509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:14.572217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.574751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.575098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.585814 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:14.622631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 874/1766] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:14.623974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.624265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.624837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.671266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] MFA Rules not processed for user `e418dab8fcbc4eb09563b31f0f645e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:14.676413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:14.754690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:14.756243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207e465-629a-4de7-a3bb-f488a2468886 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:14.772838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 893/1767] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:14.788056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937cfad-b4d8-4562-ac56-d37c8b09941d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.797099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937cfad-b4d8-4562-ac56-d37c8b09941d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.797514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937cfad-b4d8-4562-ac56-d37c8b09941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:14.843481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f937cfad-b4d8-4562-ac56-d37c8b09941d None None] MFA Rules not processed for user `39133da0b7e049f09431c6e3d015f567`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:14.849340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f937cfad-b4d8-4562-ac56-d37c8b09941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:14.862983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 875/1768] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:14.863836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:14.987661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 894/1769] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:14.990490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:14.990752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:14.991016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.028844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb71cd6-c2ce-429d-b126-7df50e0ad5f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.036409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] MFA Rules not processed for user `0ea736407a9846e9899e10a8320e692a`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:15.039553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:15.041867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164ca00-e78f-4e7c-908b-348757d69e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.042668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164ca00-e78f-4e7c-908b-348757d69e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.043174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164ca00-e78f-4e7c-908b-348757d69e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.043636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164ca00-e78f-4e7c-908b-348757d69e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.044943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164ca00-e78f-4e7c-908b-348757d69e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.047259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164ca00-e78f-4e7c-908b-348757d69e7a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.091891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:15.166668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 895/1770] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:15.166668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.183911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8a1b-991f-426b-b85e-832035ab6457 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.187085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 876/1771] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:14 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:15.188222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3fe3-96a3-46b0-8803-c72903629a94 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.188543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3fe3-96a3-46b0-8803-c72903629a94 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.201089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3fe3-96a3-46b0-8803-c72903629a94 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.202902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 877/1772] 10.222.0.26 () {54 vars in 912 bytes} [Thu Sep 15 11:06:15 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:15.203672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c3fe3-96a3-46b0-8803-c72903629a94 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.315740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.316746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.317164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.317684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.319128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.321637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.351182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c3fe3-96a3-46b0-8803-c72903629a94 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.367018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48fb7-7973-438d-9beb-4c1f34aa0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.368044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48fb7-7973-438d-9beb-4c1f34aa0a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.368044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48fb7-7973-438d-9beb-4c1f34aa0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.368268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48fb7-7973-438d-9beb-4c1f34aa0a32 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.368889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48fb7-7973-438d-9beb-4c1f34aa0a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.370841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48fb7-7973-438d-9beb-4c1f34aa0a32 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.437273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:15.486280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 878/1773] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:15 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:15.487951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.488343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.488723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.493275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 896/1774] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:15 2022] POST /identity/v3/projects => generated 383 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:15.493275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.514588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:15.516748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:15.626254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d59a4a-9e8f-406d-ad14-697674884ea5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.633100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 879/1775] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:06:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:15.634671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.639003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.639739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.640895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.642052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.643200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.646206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.659722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbcca6-8595-42a4-b9c0-83d9a4e879a8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.673141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 897/1776] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:15.677704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.678470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.678841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.679211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.679551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.681225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.684456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.717417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24733d-2bc2-451c-8f95-09918434563e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.730578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.730578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.730578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.730578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.743770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.745387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.761835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 898/1777] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:15.762755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.781176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f148f5-1650-4dbc-8a12-2ecd6c67ad1e service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.795467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.796252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.796624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.797002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] PATH_INFO: `/v3/projects/5ea46ea1ea5b4b1a84df5e369dfd3417/users/6b3d9e8abd1e442abab020929f0eedce/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.842620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea46ea1ea5b4b1a84df5e369dfd3417, user_id=6b3d9e8abd1e442abab020929f0eedce, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.845734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.850896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 880/1778] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:15 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:15.852448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.876106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1901-6dd8-4aa8-a64e-34a2eec35268 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:15.901813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:15.905142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:15.906427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:15.907977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:15.909290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:15.914230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:15.938180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 899/1779] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:15 2022] PUT /identity/v3/projects/5ea46ea1ea5b4b1a84df5e369dfd3417/users/6b3d9e8abd1e442abab020929f0eedce/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:15.944784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.957254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 881/1780] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:15.958800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:15.995208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2170a-6d1f-40ac-9785-49eaa162767a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:16.108475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4269-dd1c-42bf-908e-360c7666146a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:16.110258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:16.111027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.111400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.111765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] PATH_INFO: `/v3/projects/bee1699c41be40cb85949e17e030e63a/users/af09b8f8a840474086574945b612d283/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.126243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:16.127163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.127402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.127847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.128767 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:16.130663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:16.132500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee1699c41be40cb85949e17e030e63a, user_id=af09b8f8a840474086574945b612d283, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:16.135401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:16.151354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 900/1781] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:16.155026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:16.180874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989839-a1b4-4e00-9bf7-60ebe155f016 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:16.195083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64017ba6-402a-4752-a836-2cafe862edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:16.196170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64017ba6-402a-4752-a836-2cafe862edcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.196620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64017ba6-402a-4752-a836-2cafe862edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.196896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64017ba6-402a-4752-a836-2cafe862edcc admin admin] PATH_INFO: `/v3/projects/5ea46ea1ea5b4b1a84df5e369dfd3417/users/6b3d9e8abd1e442abab020929f0eedce/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.203214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64017ba6-402a-4752-a836-2cafe862edcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea46ea1ea5b4b1a84df5e369dfd3417, user_id=6b3d9e8abd1e442abab020929f0eedce, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:16.205933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64017ba6-402a-4752-a836-2cafe862edcc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:16.216240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 882/1782] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:15 2022] PUT /identity/v3/projects/bee1699c41be40cb85949e17e030e63a/users/af09b8f8a840474086574945b612d283/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:16.220599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:16.248629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 901/1783] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:16 2022] PUT /identity/v3/projects/5ea46ea1ea5b4b1a84df5e369dfd3417/users/6b3d9e8abd1e442abab020929f0eedce/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:16.261058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.261610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.262036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.323943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] MFA Rules not processed for user `6b3d9e8abd1e442abab020929f0eedce`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:16.325853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:16.344603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa782-f950-410b-8edd-6cb2267bfda1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:16.442055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:16.443619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.443938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.444359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.445904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:16.447335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:16.486710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 883/1784] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:16.491748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:16.504266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a71647-cda5-41ff-8e2e-bc3d805f4d0e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:16.514498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce45af4-86cc-46dd-a282-99c6762299d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:16.515421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45af4-86cc-46dd-a282-99c6762299d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.515839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45af4-86cc-46dd-a282-99c6762299d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.516258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce45af4-86cc-46dd-a282-99c6762299d3 admin admin] PATH_INFO: `/v3/projects/bee1699c41be40cb85949e17e030e63a/users/af09b8f8a840474086574945b612d283/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.524812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce45af4-86cc-46dd-a282-99c6762299d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee1699c41be40cb85949e17e030e63a, user_id=af09b8f8a840474086574945b612d283, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:16.529380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 902/1785] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:16.529539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce45af4-86cc-46dd-a282-99c6762299d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:16.539452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:16.557439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 884/1786] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:16 2022] PUT /identity/v3/projects/bee1699c41be40cb85949e17e030e63a/users/af09b8f8a840474086574945b612d283/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:16.588868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.591039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.591375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.665380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed8d2-82c1-4800-bfff-334de0414af0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:16.742018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] MFA Rules not processed for user `af09b8f8a840474086574945b612d283`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:16.743269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:16.746232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:16.746989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:16.747916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:16.748296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:16.829252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:16.832122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:16.856229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 903/1787] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:16.930150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:17.096678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 885/1788] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:17.226524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:17.237139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee06fa0-93f1-471d-bba0-f3a844205de6 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:17.248245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172813-9963-4f0c-ac07-440bc929a8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:17.248900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172813-9963-4f0c-ac07-440bc929a8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:17.252121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172813-9963-4f0c-ac07-440bc929a8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:17.259058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172813-9963-4f0c-ac07-440bc929a8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:17.259058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:17.289051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a172813-9963-4f0c-ac07-440bc929a8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:17.290581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a172813-9963-4f0c-ac07-440bc929a8f5 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:17.328093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 904/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:17.999174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:18.011861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0b8ba-dd5c-407e-8d40-40daafb8808a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:18.028643 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb70195-8f2f-42fd-8ab4-e86d70a5db96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:18.029252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb70195-8f2f-42fd-8ab4-e86d70a5db96 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:18.031922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb70195-8f2f-42fd-8ab4-e86d70a5db96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:18.032220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb70195-8f2f-42fd-8ab4-e86d70a5db96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:18.264045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb70195-8f2f-42fd-8ab4-e86d70a5db96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:18.265810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb70195-8f2f-42fd-8ab4-e86d70a5db96 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:18.299943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 886/1790] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:18.637724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:19.043177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:19.044012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:19.045049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:19.082315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:19.122444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] MFA Rules not processed for user `d8d1da88813d49cf9abb7b626a94259e`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:19.123971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:19.295444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 905/1791] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:19.846935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:19.847432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:19.847529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:19.931620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:19.933569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:20.097874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 887/1792] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:20.675910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:20.678286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:20.918816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42b19-04e3-4da8-a4d6-3b143a88ca8d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:20.936531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde78c2-026f-407f-956b-ddfb0bf31821 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:20.937171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde78c2-026f-407f-956b-ddfb0bf31821 service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:20.937454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde78c2-026f-407f-956b-ddfb0bf31821 service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:20.937731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde78c2-026f-407f-956b-ddfb0bf31821 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:20.962254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde78c2-026f-407f-956b-ddfb0bf31821 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:20.964127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde78c2-026f-407f-956b-ddfb0bf31821 service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:20.992008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 906/1793] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:06:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:06:21.185648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:21.839084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:22.825739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:23.188112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7467ee-adfe-4856-8d78-659f5c43c746 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:23.214871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:23.220587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:23.221097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:23.223127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] PATH_INFO: `/v3/users/e418dab8fcbc4eb09563b31f0f645e22` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:23.228758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e418dab8fcbc4eb09563b31f0f645e22)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:23.254593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:23.751087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:23.752249 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:23.752773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:23.768452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e418dab8fcbc4eb09563b31f0f645e22'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:23.801004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:23.802790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:23.879618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e418dab8fcbc4eb09563b31f0f645e22'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:23.881752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e418dab8fcbc4eb09563b31f0f645e22'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:23.882615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e418dab8fcbc4eb09563b31f0f645e22'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:23.899929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e418dab8fcbc4eb09563b31f0f645e22'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:23.982821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 907/1794] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Sep 15 11:06:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:23.996302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 888/1795] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:22 2022] DELETE /identity/v3/users/e418dab8fcbc4eb09563b31f0f645e22 => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:24.052686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:24.052686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:24.054191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:24.054191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:24.072597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822a514-f07d-46f0-a80d-f52604bc3f50 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:24.195037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fb8e7-34d3-44f7-82a4-aef97e95ac67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:24.196225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb8e7-34d3-44f7-82a4-aef97e95ac67 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:24.196762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb8e7-34d3-44f7-82a4-aef97e95ac67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:24.197228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb8e7-34d3-44f7-82a4-aef97e95ac67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:24.227877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fb8e7-34d3-44f7-82a4-aef97e95ac67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:24.230834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fb8e7-34d3-44f7-82a4-aef97e95ac67 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:24.254341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 908/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:24.257372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:24.258257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:24.259001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:24.309213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:24.311882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:24.312942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbefbc4-e96c-44cb-94d4-1dfd42a69a0b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:24.329808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:24.329808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:24.329808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:24.329808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] PATH_INFO: `/v3/users/b47435496dcc4f93a22a141d8f9776d9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:24.344377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 909/1797] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:24.358314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47435496dcc4f93a22a141d8f9776d9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:24.360025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:24.468396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:24.513910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:24.522206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:24.544961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa49f9-feec-45ac-bd5d-269200398a11 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:24.553154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ca496-0476-45df-83bd-4483ff3e533a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:24.554067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca496-0476-45df-83bd-4483ff3e533a service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:24.554637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca496-0476-45df-83bd-4483ff3e533a service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:24.555214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ca496-0476-45df-83bd-4483ff3e533a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:24.580149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ca496-0476-45df-83bd-4483ff3e533a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:24.584993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ca496-0476-45df-83bd-4483ff3e533a service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:24.656784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47435496dcc4f93a22a141d8f9776d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:24.660143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 910/1798] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:24.742710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47435496dcc4f93a22a141d8f9776d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:24.743473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47435496dcc4f93a22a141d8f9776d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:24.744147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47435496dcc4f93a22a141d8f9776d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:24.759847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47435496dcc4f93a22a141d8f9776d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:24.832208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 889/1799] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:24 2022] DELETE /identity/v3/users/b47435496dcc4f93a22a141d8f9776d9 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:24.834005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:24.834534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:24.834534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:24.880583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:24.883872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:24.896188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:25.111722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 911/1800] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:25.273910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:25.275397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:25.429520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f8d0-3b7c-421a-9abb-e0babc7f2f3d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:25.437683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d385f2c-7e5c-47f0-a979-ac9e9407e507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:25.438320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d385f2c-7e5c-47f0-a979-ac9e9407e507 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:25.444162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d385f2c-7e5c-47f0-a979-ac9e9407e507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:25.444510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d385f2c-7e5c-47f0-a979-ac9e9407e507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:25.466693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d385f2c-7e5c-47f0-a979-ac9e9407e507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:25.468364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d385f2c-7e5c-47f0-a979-ac9e9407e507 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:25.498368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 890/1801] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:26.223242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:26.225080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:26.252283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0547f0-7896-4c6c-baa8-d118d12f998d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:26.273150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:26.274459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:26.274893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:26.276258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] PATH_INFO: `/v3/users/5cb2e84af32347f4b4a28078b27e0339` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:26.278013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb2e84af32347f4b4a28078b27e0339)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:26.281243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:26.715542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb2e84af32347f4b4a28078b27e0339'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:26.834143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb2e84af32347f4b4a28078b27e0339'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:26.835028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb2e84af32347f4b4a28078b27e0339'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:26.835683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb2e84af32347f4b4a28078b27e0339'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:26.861484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb2e84af32347f4b4a28078b27e0339'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:26.936067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 912/1802] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:26 2022] DELETE /identity/v3/users/5cb2e84af32347f4b4a28078b27e0339 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:26.941129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e603-0d26-44a8-8863-2594cc20367d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:26.941970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e603-0d26-44a8-8863-2594cc20367d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:26.941970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e603-0d26-44a8-8863-2594cc20367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:26.988059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5978e603-0d26-44a8-8863-2594cc20367d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:27.005578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5978e603-0d26-44a8-8863-2594cc20367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:27.094841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:27.127169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 891/1803] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:27.232349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:27.234539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:27.417337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f40ba0-23f3-4f0a-b39d-8d05e5e99900 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:27.429881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d218c-6c35-4535-8d30-054d91b243fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:27.442293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d218c-6c35-4535-8d30-054d91b243fc service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:27.442293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d218c-6c35-4535-8d30-054d91b243fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:27.442293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d218c-6c35-4535-8d30-054d91b243fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:27.463621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d218c-6c35-4535-8d30-054d91b243fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:27.465798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d218c-6c35-4535-8d30-054d91b243fc service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:27.502600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 913/1804] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:27.807719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8364e8-9a6c-4224-9980-67716942a890 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:27.809503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8364e8-9a6c-4224-9980-67716942a890 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:27.809943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8364e8-9a6c-4224-9980-67716942a890 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:27.811572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 892/1805] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:27.824341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:27.866538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:27.867286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:27.867750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:27.877085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8364e8-9a6c-4224-9980-67716942a890 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:27.879144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e8364e8-9a6c-4224-9980-67716942a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:27.933891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8364e8-9a6c-4224-9980-67716942a890 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:27.947827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:27.950222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:27.952925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:27.953687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:27.954127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] PATH_INFO: `/v3/projects/d68db952ee0c4c87bb9234aa09dc75c1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:27.957242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:27.957430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68db952ee0c4c87bb9234aa09dc75c1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:27.963683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:28.166202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68db952ee0c4c87bb9234aa09dc75c1', 'request_id': 'req-396916a9-1087-4784-b6be-0961f9fba3d4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:28.181928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68db952ee0c4c87bb9234aa09dc75c1', 'request_id': 'req-396916a9-1087-4784-b6be-0961f9fba3d4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:28.185178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 914/1806] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:06:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:28.260707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68db952ee0c4c87bb9234aa09dc75c1', 'request_id': 'req-396916a9-1087-4784-b6be-0961f9fba3d4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:28.278541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] The token cache is being invalidate because project d68db952ee0c4c87bb9234aa09dc75c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:28.279222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:28.280173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:28.292511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 893/1807] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:27 2022] DELETE /identity/v3/projects/d68db952ee0c4c87bb9234aa09dc75c1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:28.295088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:28.326776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0a8d-1628-44c4-9fb8-877b848941f0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:28.597348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:28.607735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:28.608341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:28.608791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] PATH_INFO: `/v3/users/6b3d9e8abd1e442abab020929f0eedce` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:28.616867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3d9e8abd1e442abab020929f0eedce)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:28.619732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:28.908525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3d9e8abd1e442abab020929f0eedce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:29.025250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3d9e8abd1e442abab020929f0eedce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:29.026045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3d9e8abd1e442abab020929f0eedce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:29.034274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:29.035785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:29.042904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3d9e8abd1e442abab020929f0eedce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:29.100337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3d9e8abd1e442abab020929f0eedce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:29.154606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 915/1808] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:28 2022] DELETE /identity/v3/users/6b3d9e8abd1e442abab020929f0eedce => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:29.212115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396916a9-1087-4784-b6be-0961f9fba3d4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:29.341756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:29.343667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:29.344257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:29.344821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:29.348491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:29.380735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:29.382656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:29.412002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 894/1809] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:29.498268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:29.500478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:29.550792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:29.722822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dae31-86cc-49f6-b3a4-6550a5411b91 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:29.738204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:29.738976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:29.739969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:29.742292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] PATH_INFO: `/v3/projects/e8f67477bf3144bd96f9c4145823e3c7` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:29.747552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f67477bf3144bd96f9c4145823e3c7)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:29.747552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:29.986220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f67477bf3144bd96f9c4145823e3c7', 'request_id': 'req-d5ca0cee-df30-43e9-8a78-f71191266d55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.016725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f67477bf3144bd96f9c4145823e3c7', 'request_id': 'req-d5ca0cee-df30-43e9-8a78-f71191266d55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.037957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:30.093738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f67477bf3144bd96f9c4145823e3c7', 'request_id': 'req-d5ca0cee-df30-43e9-8a78-f71191266d55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.118583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] The token cache is being invalidate because project e8f67477bf3144bd96f9c4145823e3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:30.119011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.119562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.123896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 916/1810] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:29 2022] DELETE /identity/v3/projects/e8f67477bf3144bd96f9c4145823e3c7 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:30.127774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:30.140366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c525e1c-cffa-4ca6-80a5-165abc0e168c service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:30.251361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:30.253340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:30.253340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:30.253340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] PATH_INFO: `/v3/users/af09b8f8a840474086574945b612d283` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:30.254088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af09b8f8a840474086574945b612d283)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:30.257021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:30.586400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af09b8f8a840474086574945b612d283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.667935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af09b8f8a840474086574945b612d283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.668691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af09b8f8a840474086574945b612d283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.669390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af09b8f8a840474086574945b612d283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.679864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af09b8f8a840474086574945b612d283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:30.750919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 895/1811] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:30 2022] DELETE /identity/v3/users/af09b8f8a840474086574945b612d283 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:30.912207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:31.010036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:31.011938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:31.048652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0cee-df30-43e9-8a78-f71191266d55 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:31.182368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:31.183514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:31.184775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:31.186061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] PATH_INFO: `/v3/projects/dc11718acb2a40e997122d6f12969422` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:31.203207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc11718acb2a40e997122d6f12969422)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:31.206847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:31.392907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc11718acb2a40e997122d6f12969422', 'request_id': 'req-cd0af341-c665-458f-8f21-104c06d41b17'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:31.408069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc11718acb2a40e997122d6f12969422', 'request_id': 'req-cd0af341-c665-458f-8f21-104c06d41b17'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:31.554115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc11718acb2a40e997122d6f12969422', 'request_id': 'req-cd0af341-c665-458f-8f21-104c06d41b17'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:31.571196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] The token cache is being invalidate because project dc11718acb2a40e997122d6f12969422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:31.573087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:31.574839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cd0af341-c665-458f-8f21-104c06d41b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:31.579298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 917/1812] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:31 2022] DELETE /identity/v3/projects/dc11718acb2a40e997122d6f12969422 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:31.580844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:31.583061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:31.603669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d12f8-277f-4a2c-a9ea-09127115505b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:31.781747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:31.782836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:31.783351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:31.783834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] PATH_INFO: `/v3/users/710c1a055e1f4710a336b35c8a37eeaa` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:31.787596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710c1a055e1f4710a336b35c8a37eeaa)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:31.790403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:31.804489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366799d-2e65-4c15-9d69-b37345ab366c None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:31.804861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366799d-2e65-4c15-9d69-b37345ab366c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:31.805245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366799d-2e65-4c15-9d69-b37345ab366c None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:31.806978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 918/1813] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:32.007849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:32.008602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:32.009317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:32.056018 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:32.061668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:32.191486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710c1a055e1f4710a336b35c8a37eeaa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:32.238903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:32.283188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 919/1814] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:32.296099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710c1a055e1f4710a336b35c8a37eeaa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:32.299347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710c1a055e1f4710a336b35c8a37eeaa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:32.299347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710c1a055e1f4710a336b35c8a37eeaa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:32.314619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710c1a055e1f4710a336b35c8a37eeaa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:32.340554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 896/1815] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:31 2022] DELETE /identity/v3/users/710c1a055e1f4710a336b35c8a37eeaa => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:32.752898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:32.754853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:32.792639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b180932-7e98-4361-8b72-2761205ff96c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:32.845497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:32.860059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:32.992145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:32.992673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:32.992952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:32.993224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] PATH_INFO: `/v3/projects/bee1699c41be40cb85949e17e030e63a` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:32.994502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee1699c41be40cb85949e17e030e63a)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:32.996703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:33.134749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e8d02-85e4-48ab-9595-58ff0cd80728 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:33.149031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee1699c41be40cb85949e17e030e63a', 'request_id': 'req-baee0d89-c8d1-4d1e-8fe3-6a5248727318'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.165898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee1699c41be40cb85949e17e030e63a', 'request_id': 'req-baee0d89-c8d1-4d1e-8fe3-6a5248727318'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.269601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:33.282020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:33.282447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:33.282801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:33.288001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee1699c41be40cb85949e17e030e63a', 'request_id': 'req-baee0d89-c8d1-4d1e-8fe3-6a5248727318'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.289599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:33.293563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:33.320910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] The token cache is being invalidate because project bee1699c41be40cb85949e17e030e63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:33.333412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.333412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.334097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:33.334097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283cc10-5751-40b1-8d8e-8d4e0a3d237b service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:33.334262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 920/1816] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:32 2022] DELETE /identity/v3/projects/bee1699c41be40cb85949e17e030e63a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:33.334262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:33.334262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:33.392997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 897/1817] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:33.396904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dff43-37fb-49ee-9f6a-61b3a376d431 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:33.396904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dff43-37fb-49ee-9f6a-61b3a376d431 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:33.397058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dff43-37fb-49ee-9f6a-61b3a376d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:33.467902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8a3dff43-37fb-49ee-9f6a-61b3a376d431 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:33.467902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8a3dff43-37fb-49ee-9f6a-61b3a376d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:33.565815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee0d89-c8d1-4d1e-8fe3-6a5248727318 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:33.591589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:33.592303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:33.592637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:33.592921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] PATH_INFO: `/v3/projects/5ea46ea1ea5b4b1a84df5e369dfd3417` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:33.599718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea46ea1ea5b4b1a84df5e369dfd3417)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:33.602003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:33.634792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 898/1818] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:33.645918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:33.646554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:33.647303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:33.701719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:33.704882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:33.734886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 899/1819] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:33.740110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:33.755792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132308da-af00-4774-8ea6-4cffa365bb29 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:33.783753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:33.786249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:33.786527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:33.788136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:33.788872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:33.791927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:33.794186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:33.829754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea46ea1ea5b4b1a84df5e369dfd3417', 'request_id': 'req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.838760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea46ea1ea5b4b1a84df5e369dfd3417', 'request_id': 'req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.861169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 900/1820] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:06:33.863768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:33.889213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f5525-71b3-4049-bff1-7a03a8b11add admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:33.907921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea46ea1ea5b4b1a84df5e369dfd3417', 'request_id': 'req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.931376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] The token cache is being invalidate because project 5ea46ea1ea5b4b1a84df5e369dfd3417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:33.931688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.932631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b8b5cc7f-b34e-4ec6-81c2-cb584810a3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:33.938934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 921/1821] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:33 2022] DELETE /identity/v3/projects/5ea46ea1ea5b4b1a84df5e369dfd3417 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:33.943870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a579b-93cd-45e1-b04a-5194ddd27fb3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:33.944224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a579b-93cd-45e1-b04a-5194ddd27fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:33.946868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a579b-93cd-45e1-b04a-5194ddd27fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.021298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b52a579b-93cd-45e1-b04a-5194ddd27fb3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:34.053795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b52a579b-93cd-45e1-b04a-5194ddd27fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:34.054707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:34.054707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.054707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.054707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.055049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:34.055149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 922/1822] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:34.055232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:34.068022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.077200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.078685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.117515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:34.119019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:34.129373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 923/1823] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:34.135783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:34.151295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501b808-623e-45e5-b3af-81dbafb9ae66 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:34.159537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:34.160576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.161153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.161743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.162675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:34.164132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:34.176026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:34.196191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 924/1824] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:34.205070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:34.217811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33fa8-f759-43b9-9011-db294a5e8ea9 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:34.226642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:34.227441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.227818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.228183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.228956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:34.231105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:34.333886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 901/1825] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:33 2022] POST /identity/v3/projects => generated 387 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:34.339499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:34.344576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:34.394311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 925/1826] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:34 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:34.398466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:34.571735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133c759-1ddb-4058-a4f3-ca96cb565740 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:34.601602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad10f-3a74-4fba-a62f-2a4cae92b8f6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:34.624298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:34.625826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.626458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.626895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.628924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:34.633145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:34.710407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:34.711283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.712649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.712649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.716072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:34.721661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:34.775087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 926/1827] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:34 2022] POST /identity/v3/users => generated 290 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:06:34.775435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:34.779342 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:34.807623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d8594-21d2-4080-a216-1083e4c88999 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:34.813407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:34.814200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:34.814593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:34.814963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] PATH_INFO: `/v3/projects/51aee0803be74f749c2e6e58cbd05f19` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:34.816379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51aee0803be74f749c2e6e58cbd05f19)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:34.834354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:34.984341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 902/1828] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:34 2022] POST /identity/v3/users => generated 294 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:34.984341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.012082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d8921-9b92-44e8-a2c4-475d1419e368 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.060416 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51aee0803be74f749c2e6e58cbd05f19', 'request_id': 'req-deb85387-538b-42bc-8cfe-f19262b7a056'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:35.079615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51aee0803be74f749c2e6e58cbd05f19', 'request_id': 'req-deb85387-538b-42bc-8cfe-f19262b7a056'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:35.148799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.149927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.152518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.153023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.154781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.157714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.173082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51aee0803be74f749c2e6e58cbd05f19', 'request_id': 'req-deb85387-538b-42bc-8cfe-f19262b7a056'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:35.183234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 903/1829] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:35.184681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.191431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] The token cache is being invalidate because project 51aee0803be74f749c2e6e58cbd05f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:35.193989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:35.195320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:35.204208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 927/1830] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:34 2022] DELETE /identity/v3/projects/51aee0803be74f749c2e6e58cbd05f19 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:35.211664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.216200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:35.233183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facc7af-dee1-4670-b864-9572d6e15672 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.252839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf819a-f278-47af-971e-aef55492ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.258371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf819a-f278-47af-971e-aef55492ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.258371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf819a-f278-47af-971e-aef55492ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.258371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf819a-f278-47af-971e-aef55492ff20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.258371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf819a-f278-47af-971e-aef55492ff20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.258371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf819a-f278-47af-971e-aef55492ff20 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.278901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 904/1831] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:35.283766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.283980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.284246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.297442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb85387-538b-42bc-8cfe-f19262b7a056 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.316181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.316863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.319830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.320169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.320939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.328604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.329006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:35.329762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:35.339942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 928/1832] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:35.345020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.347481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:35.349048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 905/1833] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:35.351736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.371676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082be55-5b73-4a0a-9669-aa688d18a1a3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.384142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d5d8-e875-4dc8-a423-50721e7a4b71 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.388361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.389658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.390224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.390760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] PATH_INFO: `/v3/projects/0e3fb6b16ddb49d99d31f992c1df224a/users/7c4bec23d9dd4b19b14016daf3390e0d/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.390874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe21ea-3ca0-4780-9928-d5dd04c649be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.391547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe21ea-3ca0-4780-9928-d5dd04c649be admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.392057 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe21ea-3ca0-4780-9928-d5dd04c649be admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.392172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe21ea-3ca0-4780-9928-d5dd04c649be admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.393182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe21ea-3ca0-4780-9928-d5dd04c649be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.397645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe21ea-3ca0-4780-9928-d5dd04c649be admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.410497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 929/1834] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:35.412660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.413115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.413952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.421271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3fb6b16ddb49d99d31f992c1df224a, user_id=7c4bec23d9dd4b19b14016daf3390e0d, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.428976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.448883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:35.450396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:35.478458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 930/1835] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:35.479624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.492805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff23b0-c17e-4874-896b-cdea1f588d04 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.499386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb4f0e-9b1c-4a0d-824c-2437eb58dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.499610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4f0e-9b1c-4a0d-824c-2437eb58dfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.500237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4f0e-9b1c-4a0d-824c-2437eb58dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.500237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb4f0e-9b1c-4a0d-824c-2437eb58dfdd admin admin] PATH_INFO: `/v3/projects/b32963554fa749b69fc7bef4d2f3cd79/users/88d739ac8f564d659f0ca693a0a85654/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.522519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 906/1836] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:35 2022] PUT /identity/v3/projects/0e3fb6b16ddb49d99d31f992c1df224a/users/7c4bec23d9dd4b19b14016daf3390e0d/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:35.525571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.535201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb4f0e-9b1c-4a0d-824c-2437eb58dfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32963554fa749b69fc7bef4d2f3cd79, user_id=88d739ac8f564d659f0ca693a0a85654, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.538199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb4f0e-9b1c-4a0d-824c-2437eb58dfdd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.580605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:35.625313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 931/1837] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:35 2022] PUT /identity/v3/projects/b32963554fa749b69fc7bef4d2f3cd79/users/88d739ac8f564d659f0ca693a0a85654/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:35.625313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec60c4-31ef-4a9b-868a-ab6935ec8857 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.625313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec60c4-31ef-4a9b-868a-ab6935ec8857 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.625313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec60c4-31ef-4a9b-868a-ab6935ec8857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.678915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a265c1-2449-4a67-a856-191af98ade70 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.682130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-cdec60c4-31ef-4a9b-868a-ab6935ec8857 None None] MFA Rules not processed for user `7c4bec23d9dd4b19b14016daf3390e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:35.684817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cdec60c4-31ef-4a9b-868a-ab6935ec8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:35.780862 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.782511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.782798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.783078 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.783754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:35.784062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.786246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.814202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 932/1838] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:35.816064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192455e-7879-47f2-accb-0473a3970edf None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.816419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192455e-7879-47f2-accb-0473a3970edf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.816709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192455e-7879-47f2-accb-0473a3970edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.828430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 907/1839] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:35.833800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.856444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e5ef0-9f2c-40af-93ac-63cad0a3f6b5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.868439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.868439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.868439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.868439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.868937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3192455e-7879-47f2-accb-0473a3970edf None None] MFA Rules not processed for user `88d739ac8f564d659f0ca693a0a85654`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:35.869476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3192455e-7879-47f2-accb-0473a3970edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:35.870059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.872498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.943577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 933/1840] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:35.945172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192455e-7879-47f2-accb-0473a3970edf None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:35.955899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192455e-7879-47f2-accb-0473a3970edf None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:35.961791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:35.962460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:35.962714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:35.962965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:35.963628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:35.965587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:35.986443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 908/1841] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:35.989459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.044262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:36.064070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 934/1842] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:36.066064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.113353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa13f4b-6bae-43f3-baa3-eb3469bf7ca7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.173560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dda12-5d76-449a-a360-eedb6d01440c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.190868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.193355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.193355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.193355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.193355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.197513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.207012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.209415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.209740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.209981 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.210629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.212855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.277966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 935/1843] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:36 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:36.277966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.290217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f1070-3f23-42f3-ab21-eaae5da14f49 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.296160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.297588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.301993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.301993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.301993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.301993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.340764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 909/1844] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:35 2022] POST /identity/v3/projects => generated 389 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:36.342043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.406516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9645b-d0ba-4d45-8435-52eeeaa7c0c0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.412249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.419044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.419044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.419044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.419044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.419425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 936/1845] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:36 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:36.419425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.419599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.427623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 910/1846] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:36.428765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.432460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b45b-1227-4624-90b8-627561482b7d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.438397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.439173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.439461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.439741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.440651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.447554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f8c34-d6bd-4369-91a3-fb20b0d25514 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.447871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.447970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.447970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.447970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.447970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.448469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.450034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.461765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 911/1847] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:36.461765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.472693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d18c5d-e6a4-406c-a077-4e622cfe28ac admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.477676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.478351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.478628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.478903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] PATH_INFO: `/v3/projects/2c8cb435eaa245468c41fadce4e7178f/users/4410b537671143faaa6117a96f526767/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.493821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8cb435eaa245468c41fadce4e7178f, user_id=4410b537671143faaa6117a96f526767, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.496478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.556891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 937/1848] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:36 2022] POST /identity/v3/users => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:36.560094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.567924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733d699-6f4d-4001-a18c-d736d2ebea2e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.572860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.573447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.573726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.573998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.574625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.576180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.585823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 912/1849] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:36 2022] PUT /identity/v3/projects/2c8cb435eaa245468c41fadce4e7178f/users/4410b537671143faaa6117a96f526767/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:36.587214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.591008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 938/1850] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:36.593750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.604441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c263292-f039-435d-bf04-f6cbf5fa5ab5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.652286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0b1c-0e55-425d-ba47-255f8b539869 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.659990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.662735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.663376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.663657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.663931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.664613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.666295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.668543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.668834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.669303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.669842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.671815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.676937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 939/1851] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:36.678447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.691097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 913/1852] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:36.691097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.693440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10952a-eb71-412b-87bd-ba472497be84 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.698341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b4a33-96b1-4604-ae4a-b9326661d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.699043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b4a33-96b1-4604-ae4a-b9326661d255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.699319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b4a33-96b1-4604-ae4a-b9326661d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.700257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b4a33-96b1-4604-ae4a-b9326661d255 admin admin] PATH_INFO: `/v3/projects/a68af1d805a54b5f8d9b6f69c8a2cc31/users/7dade79abd9848a89526c6d8978f487b/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.704352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194717c0-6f1c-4151-a9fd-e85ab1401610 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.710476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.716186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.716186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.716186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] PATH_INFO: `/v3/projects/2c8cb435eaa245468c41fadce4e7178f/users/4410b537671143faaa6117a96f526767/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.716186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8cb435eaa245468c41fadce4e7178f, user_id=4410b537671143faaa6117a96f526767, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.716545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b4a33-96b1-4604-ae4a-b9326661d255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68af1d805a54b5f8d9b6f69c8a2cc31, user_id=7dade79abd9848a89526c6d8978f487b, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.716627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.718795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b4a33-96b1-4604-ae4a-b9326661d255 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.727266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 914/1853] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:36 2022] PUT /identity/v3/projects/2c8cb435eaa245468c41fadce4e7178f/users/4410b537671143faaa6117a96f526767/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:36.728182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:36.790498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8ee02-ee99-4203-b5a8-60e304761dda admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:36.796630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1a1f3-b009-4ab8-a667-5456c71f6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:36.797738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1a1f3-b009-4ab8-a667-5456c71f6b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.798239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1a1f3-b009-4ab8-a667-5456c71f6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.798731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1a1f3-b009-4ab8-a667-5456c71f6b15 admin admin] PATH_INFO: `/v3/projects/661bc7e2b1c64016bc590c9aec8045b3/users/47c9ca8a5db5490eb16e027eddd7354f/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.814836 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1a1f3-b009-4ab8-a667-5456c71f6b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661bc7e2b1c64016bc590c9aec8045b3, user_id=47c9ca8a5db5490eb16e027eddd7354f, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:36.818380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1a1f3-b009-4ab8-a667-5456c71f6b15 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:36.840991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 940/1854] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:36 2022] PUT /identity/v3/projects/a68af1d805a54b5f8d9b6f69c8a2cc31/users/7dade79abd9848a89526c6d8978f487b/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:36.840991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.840991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.840991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.880721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] MFA Rules not processed for user `4410b537671143faaa6117a96f526767`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:36.882208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:36.942980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 915/1855] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:36 2022] PUT /identity/v3/projects/661bc7e2b1c64016bc590c9aec8045b3/users/47c9ca8a5db5490eb16e027eddd7354f/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:36.944558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:36.944904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:36.945459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:36.970269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 941/1856] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:36.970269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.004287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] MFA Rules not processed for user `7dade79abd9848a89526c6d8978f487b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:37.006300 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:37.045521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410eee85-693f-4c96-a1a6-a0f644b87fed None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.108571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 916/1857] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:37.109646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.110304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.111164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.111294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:37.111385 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.111668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.112484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.115020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.126178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 942/1858] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:37.127401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.129117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:37.175030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f546-2ede-4699-abf5-2ad00ae11449 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.179589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c311b3-c54b-454d-8675-4325ce2e6629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.182521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c311b3-c54b-454d-8675-4325ce2e6629 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.182521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c311b3-c54b-454d-8675-4325ce2e6629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.182521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c311b3-c54b-454d-8675-4325ce2e6629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.188054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376cd4-2e4d-4435-8ca6-64258efa2a54 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.191891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.193074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.193336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.193607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.201974 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.203396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.212584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 943/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:37.213370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.224748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c657a1-d42b-4988-bc1d-e1f822bbc7fe service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.234043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.234999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.235452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.235719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] PATH_INFO: `/v3/projects/661bc7e2b1c64016bc590c9aec8045b3/users/47c9ca8a5db5490eb16e027eddd7354f/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.237829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661bc7e2b1c64016bc590c9aec8045b3, user_id=47c9ca8a5db5490eb16e027eddd7354f, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.245917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.246029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c311b3-c54b-454d-8675-4325ce2e6629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.246029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c311b3-c54b-454d-8675-4325ce2e6629 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.251677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 944/1860] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:37 2022] PUT /identity/v3/projects/661bc7e2b1c64016bc590c9aec8045b3/users/47c9ca8a5db5490eb16e027eddd7354f/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:37.251918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 917/1861] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:37.253186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.263715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.264003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.264282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.294700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] MFA Rules not processed for user `47c9ca8a5db5490eb16e027eddd7354f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:37.295901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:37.340389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cadb93-64b1-4c43-a6cb-25f299ac1d88 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.349582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.351991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.352283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.353419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] PATH_INFO: `/v3/users/7dade79abd9848a89526c6d8978f487b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.355103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dade79abd9848a89526c6d8978f487b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.360421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.411337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 918/1862] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:37.415217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:37.420292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.504859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463242b-6f2b-4df5-85bf-23aa657694cf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.509830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.511043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.511328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.511605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.522243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.523677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.533617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 919/1863] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:37.659653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dade79abd9848a89526c6d8978f487b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:37.684674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.696948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd495d-de8f-4c10-91f5-13341034644c service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.701990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.702601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.702932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.703157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] PATH_INFO: `/v3/users/88d739ac8f564d659f0ca693a0a85654` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.704292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d739ac8f564d659f0ca693a0a85654)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.706384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.784682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dade79abd9848a89526c6d8978f487b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:37.785382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dade79abd9848a89526c6d8978f487b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:37.786189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dade79abd9848a89526c6d8978f487b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:37.793428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-45ecb81a-f2e1-4992-b6a4-d3fc01e7428c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dade79abd9848a89526c6d8978f487b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:37.810733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 945/1864] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:37 2022] DELETE /identity/v3/users/7dade79abd9848a89526c6d8978f487b => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:37.814959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.815243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.815517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.834447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:37.835628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:37.881885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:37.893431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 946/1865] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:37.903750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:37.905251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:37.948697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d739ac8f564d659f0ca693a0a85654'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:37.965542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180af7d-29b5-4c63-9f6b-fb5e412176f1 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:37.971026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57640b39-f32e-4d62-ae6d-0258edc26e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:37.971026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640b39-f32e-4d62-ae6d-0258edc26e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:37.971026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640b39-f32e-4d62-ae6d-0258edc26e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:37.971026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640b39-f32e-4d62-ae6d-0258edc26e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:37.980456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57640b39-f32e-4d62-ae6d-0258edc26e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:37.981871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57640b39-f32e-4d62-ae6d-0258edc26e30 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:37.992579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 947/1866] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:38.053548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d739ac8f564d659f0ca693a0a85654'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.054207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d739ac8f564d659f0ca693a0a85654'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.054838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d739ac8f564d659f0ca693a0a85654'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.062284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d739ac8f564d659f0ca693a0a85654'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.081872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 920/1867] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:37 2022] DELETE /identity/v3/users/88d739ac8f564d659f0ca693a0a85654 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:38.086497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:38.086793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:38.087077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:38.108450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:38.109640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:38.203060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 948/1868] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:38.238251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:38.240694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:38.327124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c452-6670-488d-b0ce-2b53a5a5e46b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:38.333678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:38.334237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:38.334518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:38.334789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:38.348510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:38.353182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:38.382517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 921/1869] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:38.670112 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:38.671750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:38.684087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd79b1-d2ee-4372-aaab-9b5d0f174018 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:38.689838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:38.690490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:38.694187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:38.694644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] PATH_INFO: `/v3/projects/a68af1d805a54b5f8d9b6f69c8a2cc31` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:38.697353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68af1d805a54b5f8d9b6f69c8a2cc31)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:38.699964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:38.799500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68af1d805a54b5f8d9b6f69c8a2cc31', 'request_id': 'req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.810665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68af1d805a54b5f8d9b6f69c8a2cc31', 'request_id': 'req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.857358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:38.859240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:38.867451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68af1d805a54b5f8d9b6f69c8a2cc31', 'request_id': 'req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.878132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f894d-8690-4127-9043-6713182fc958 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:38.896541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] The token cache is being invalidate because project a68af1d805a54b5f8d9b6f69c8a2cc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:38.908174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.910717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f86e1df0-7e92-46f6-ab99-1aab6d7e925c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:38.916386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 949/1870] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:38 2022] DELETE /identity/v3/projects/a68af1d805a54b5f8d9b6f69c8a2cc31 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:38.921964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eccbc-e226-4c09-a18e-9a6d8af57dd9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:38.922305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eccbc-e226-4c09-a18e-9a6d8af57dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:38.922587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eccbc-e226-4c09-a18e-9a6d8af57dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:38.948066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-103eccbc-e226-4c09-a18e-9a6d8af57dd9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:38.949071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-103eccbc-e226-4c09-a18e-9a6d8af57dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:38.969822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:38.970728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:38.971501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:38.971982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] PATH_INFO: `/v3/projects/b32963554fa749b69fc7bef4d2f3cd79` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:38.973514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32963554fa749b69fc7bef4d2f3cd79)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:38.975796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.079833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 950/1871] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:39.081773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.082058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.082333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.092328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32963554fa749b69fc7bef4d2f3cd79', 'request_id': 'req-51c621ef-9443-476d-a537-368491cf36b5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.104402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:39.105670 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:39.109239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32963554fa749b69fc7bef4d2f3cd79', 'request_id': 'req-51c621ef-9443-476d-a537-368491cf36b5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.197779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 951/1872] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:39.201991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.211021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3762-bce0-4996-9c67-4b64aa37361e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.215257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32963554fa749b69fc7bef4d2f3cd79', 'request_id': 'req-51c621ef-9443-476d-a537-368491cf36b5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.215986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.216631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.216919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.217185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.218054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:39.218361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.220241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.235995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] The token cache is being invalidate because project b32963554fa749b69fc7bef4d2f3cd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:39.235995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.235995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.239133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 952/1874] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:06:39.240919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 922/1874] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:38 2022] DELETE /identity/v3/projects/b32963554fa749b69fc7bef4d2f3cd79 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:39.244823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.244998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.246333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:39.246685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:39.264475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c621ef-9443-476d-a537-368491cf36b5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.264603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa311f-c2f4-4251-b36f-11d2b8a4be70 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.267069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.267963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.268545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.268780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.269027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] PATH_INFO: `/v3/users/47c9ca8a5db5490eb16e027eddd7354f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.269762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.270472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.270644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c9ca8a5db5490eb16e027eddd7354f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.271120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.271908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.273265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.274543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.376068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 923/1875] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:39 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:39.376068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.376562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:39.452050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956276a7-5f99-4e52-ad0c-154d2d3ae217 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.455969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.456618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.456906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.457182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.459144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:39.484093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:39.490536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c9ca8a5db5490eb16e027eddd7354f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.529151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.530595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.540783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 924/1876] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:39.541582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.586731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c9ca8a5db5490eb16e027eddd7354f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.591655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c9ca8a5db5490eb16e027eddd7354f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.593898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c9ca8a5db5490eb16e027eddd7354f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.604951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c9ca8a5db5490eb16e027eddd7354f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:39.628698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 953/1877] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:39 2022] DELETE /identity/v3/users/47c9ca8a5db5490eb16e027eddd7354f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:39.634552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430fb4a-184a-4628-bc86-68f74ae38d12 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.699935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.700771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.701480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.701924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.703005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.705929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.829124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 925/1878] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:39 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:39.834418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.837040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:39.860252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d94cf-8b31-4a87-af36-e419c0ab68fc admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.874683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.876047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.876546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.877161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.878228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.882334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.903556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 954/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:39.907922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.916371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:39.922535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa22cea-8b20-4e97-b6b0-1f829e9114f3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.930275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa819bf6-c29f-4a9d-9b31-810eab7357e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.930555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819bf6-c29f-4a9d-9b31-810eab7357e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.930778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819bf6-c29f-4a9d-9b31-810eab7357e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.931047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa819bf6-c29f-4a9d-9b31-810eab7357e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.932243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa819bf6-c29f-4a9d-9b31-810eab7357e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:39.934006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa819bf6-c29f-4a9d-9b31-810eab7357e8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:39.949998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 926/1880] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:39.951803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:39.966920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9d5f4-54ec-49d8-979d-92ee954be038 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:39.974363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:39.975485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:39.976194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:39.977087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] PATH_INFO: `/v3/projects/43f6431124d14fa6948e803cbb54f009/users/01245e3228ac42528d4d4fa9a5d8f65f/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:39.998945 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f6431124d14fa6948e803cbb54f009, user_id=01245e3228ac42528d4d4fa9a5d8f65f, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:40.002775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:40.120735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 955/1881] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:39 2022] PUT /identity/v3/projects/43f6431124d14fa6948e803cbb54f009/users/01245e3228ac42528d4d4fa9a5d8f65f/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:40.129892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:40.130380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:40.130696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:40.171409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] MFA Rules not processed for user `01245e3228ac42528d4d4fa9a5d8f65f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:40.174312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:40.263268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 927/1882] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:40.278601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:40.286432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:40.351056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da68ad-2d92-4933-b579-5523f4da0c45 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:40.354951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:40.355629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:40.355914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:40.356364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:40.367564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:40.372425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:40.378859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 956/1883] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:40.407147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:40.551251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa8fb4-c220-41ef-8fd3-0aa4b3c47ab2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:40.557679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:40.558543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:40.558893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:40.559396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] PATH_INFO: `/v3/users/01245e3228ac42528d4d4fa9a5d8f65f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:40.560970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01245e3228ac42528d4d4fa9a5d8f65f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:40.563561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:40.707103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:40.710161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:40.733750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e244e2d-0419-4352-9bc4-39b80152bb59 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:40.739947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:40.741070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:40.741351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:40.741799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] PATH_INFO: `/v3/projects/661bc7e2b1c64016bc590c9aec8045b3` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:40.743982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=661bc7e2b1c64016bc590c9aec8045b3)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:40.745979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:40.827497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01245e3228ac42528d4d4fa9a5d8f65f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.909426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661bc7e2b1c64016bc590c9aec8045b3', 'request_id': 'req-b6f58e03-c3b1-4c38-a996-0accfafc8eff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.915761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01245e3228ac42528d4d4fa9a5d8f65f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.917222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01245e3228ac42528d4d4fa9a5d8f65f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.919293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01245e3228ac42528d4d4fa9a5d8f65f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.920647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661bc7e2b1c64016bc590c9aec8045b3', 'request_id': 'req-b6f58e03-c3b1-4c38-a996-0accfafc8eff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.931742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fbc19c41-688a-4524-9423-aafa69613869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01245e3228ac42528d4d4fa9a5d8f65f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:40.977402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 928/1884] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:40 2022] DELETE /identity/v3/users/01245e3228ac42528d4d4fa9a5d8f65f => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:40.980506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:40.981070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:40.982229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.003519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661bc7e2b1c64016bc590c9aec8045b3', 'request_id': 'req-b6f58e03-c3b1-4c38-a996-0accfafc8eff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:41.004787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:41.006168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:41.041285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] The token cache is being invalidate because project 661bc7e2b1c64016bc590c9aec8045b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:41.041588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:41.042504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6f58e03-c3b1-4c38-a996-0accfafc8eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:41.044214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 957/1885] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:40 2022] DELETE /identity/v3/projects/661bc7e2b1c64016bc590c9aec8045b3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:41.053625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a07e-fbe6-49df-b037-1b1f8923ef49 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.053971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a07e-fbe6-49df-b037-1b1f8923ef49 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.054242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76a07e-fbe6-49df-b037-1b1f8923ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.077848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:41.083923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6a76a07e-fbe6-49df-b037-1b1f8923ef49 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:41.085529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6a76a07e-fbe6-49df-b037-1b1f8923ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:41.104157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 929/1886] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:41.118344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.121230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:41.194766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:41.233286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 958/1887] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:41.236910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.237250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.237672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.237786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860c7e-3933-40ee-a617-b8882ad7b40e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.242968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.243289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.243648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.244063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.254667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.256422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.259234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:41.260569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:41.267787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 930/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:41.271199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 959/1889] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:41.275186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.289777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358f5b3-e5a3-441c-b515-e9407bcb8105 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.296534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.297348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.297631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.298427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.299134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:41.299801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.302198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.318684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 931/1890] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:41.319869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.330252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a90e-d722-4c04-afc0-53310912ae20 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.336896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067340-070a-4855-9209-00447fbe7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.337370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067340-070a-4855-9209-00447fbe7229 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.343238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067340-070a-4855-9209-00447fbe7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.343238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067340-070a-4855-9209-00447fbe7229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.343238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067340-070a-4855-9209-00447fbe7229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.343238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067340-070a-4855-9209-00447fbe7229 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.460315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.467884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 960/1891] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:41 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:41.471664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca522-5a4e-4f14-8d7c-6a93e425c474 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.510721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda92ddb-18ab-4e05-bc04-dbccdd88eb46 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.511009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda92ddb-18ab-4e05-bc04-dbccdd88eb46 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.512130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda92ddb-18ab-4e05-bc04-dbccdd88eb46 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.513169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 961/1892] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:06:41.531362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.531362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.531362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.563987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:41.567025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:41.623537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.624382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.624675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.625809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.625940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.628297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.736250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 962/1893] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:41.769756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 932/1894] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:41 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:41.774755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.789644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89d73-7f60-4164-ab9a-d53456c3d46d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.795303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.795921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.796348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.796684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.797604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.799120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.820428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 963/1895] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:41.823565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.839996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f986-02a9-49c1-a753-1098c3034f79 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.846081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.846873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.847213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.847549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.848859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.849036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.850849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.851063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:41.873168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c02af-5d1e-4d98-96ee-5eee7b3c3acb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.881988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.884512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.885857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.886327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.895905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.897625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:41.905041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 933/1896] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:41.908273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:41.911236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 964/1897] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:41.919347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af752c8-56eb-41b3-8d4f-e30cb7161bfc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:41.924699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b7ec-c007-478f-8a46-b96b892c0124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:41.925364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b7ec-c007-478f-8a46-b96b892c0124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:41.925720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b7ec-c007-478f-8a46-b96b892c0124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:41.926146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b7ec-c007-478f-8a46-b96b892c0124 admin admin] PATH_INFO: `/v3/projects/d3415d21a68a4556a2487e24b0888e56/users/00e05bf11e314d27b6f7e246826807db/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:41.943759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b7ec-c007-478f-8a46-b96b892c0124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3415d21a68a4556a2487e24b0888e56, user_id=00e05bf11e314d27b6f7e246826807db, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:41.949373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b7ec-c007-478f-8a46-b96b892c0124 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.037335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.038738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:42.053412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e204e-7a27-44d5-a58a-0accd6ade968 service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.058079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.059026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.059026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.059243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] PATH_INFO: `/v3/projects/43f6431124d14fa6948e803cbb54f009` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.061404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f6431124d14fa6948e803cbb54f009)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.063110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.065867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 934/1898] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:41 2022] PUT /identity/v3/projects/d3415d21a68a4556a2487e24b0888e56/users/00e05bf11e314d27b6f7e246826807db/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:42.079462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.080133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.080542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.113751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] MFA Rules not processed for user `00e05bf11e314d27b6f7e246826807db`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:42.115675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:42.128751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:42.203811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 935/1899] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:42.208860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.224290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f6431124d14fa6948e803cbb54f009', 'request_id': 'req-489d9263-d5db-432e-ac94-6794426b4a2d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:42.244449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f6431124d14fa6948e803cbb54f009', 'request_id': 'req-489d9263-d5db-432e-ac94-6794426b4a2d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:42.284780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:42.307165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3519-a9c6-4f2a-a1a8-f7166b0cde23 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.330366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f6431124d14fa6948e803cbb54f009', 'request_id': 'req-489d9263-d5db-432e-ac94-6794426b4a2d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:42.352920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] The token cache is being invalidate because project 43f6431124d14fa6948e803cbb54f009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:42.354723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:42.356867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-489d9263-d5db-432e-ac94-6794426b4a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:42.359251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 965/1900] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:42 2022] DELETE /identity/v3/projects/43f6431124d14fa6948e803cbb54f009 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:42.365080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b256d-1d2d-4e98-b307-5cba11e31611 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.365753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b256d-1d2d-4e98-b307-5cba11e31611 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.366201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b256d-1d2d-4e98-b307-5cba11e31611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.381088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.382179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.382673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.383858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.384756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.388268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.398621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4d2b256d-1d2d-4e98-b307-5cba11e31611 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:42.400607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4d2b256d-1d2d-4e98-b307-5cba11e31611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:42.408889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 966/1901] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:42.416673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.416979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.417234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.443512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:42.444765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:42.452789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 967/1902] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:42.457048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.465981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56217d6-6ba0-4e1d-bdf0-d800e215078b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.470867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.471453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.471731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.472007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.472706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:42.473630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.475351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.494052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 968/1903] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:06:42.495126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.496104 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 936/1904] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/projects => generated 387 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:42.499237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.501025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:42.507291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf47138-655c-4293-a7d5-b4445d512860 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.565497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.566073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.566350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.566718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.567402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.569339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.572638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29aa9c-44fa-423c-93b1-20435ff6de5d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.577781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.578411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.584648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.584648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.584648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.584648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.663495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 969/1905] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:06:42.664831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.682921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 937/1906] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:42.683956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.697364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcc2ac-efdc-4d09-bdc1-f5eb199e4fa9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.747060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc875ff8-db4d-4949-9d6d-caf7b1c712e3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.751943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.752593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.752872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.753149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.753862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.757005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.777573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.778284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.778572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.778852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.779531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.781244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.792731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 938/1907] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:42.796918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.807912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42690-d5cd-49b7-888c-0b955a1a7c76 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.820467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.820467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.820685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.820958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] PATH_INFO: `/v3/projects/c85eaa59ef2d436bac7dc15b98450dd6/users/6b68cfad4fb64aa290ac52f4030b1e6f/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.840427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85eaa59ef2d436bac7dc15b98450dd6, user_id=6b68cfad4fb64aa290ac52f4030b1e6f, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.843367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.853692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 970/1908] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:42 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:06:42.858151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.870816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e97dd-8ef4-4fa5-9575-9faca72f4d9f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.876802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.877422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.877684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.880028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.880028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.881250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.896380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 971/1909] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:42.898756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.913140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d0766-9a9d-4e1e-af96-b7d6ff06389a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:42.935254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:42.936001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:42.936400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:42.936775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:42.937484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:42.939922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:42.956201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 972/1910] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:42.958902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.968223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 939/1911] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:42 2022] PUT /identity/v3/projects/c85eaa59ef2d436bac7dc15b98450dd6/users/6b68cfad4fb64aa290ac52f4030b1e6f/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:42.971927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:42.996870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26ec6-54f2-4b5a-bee4-f84f40b1bd1c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:43.085912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bfaf2-0e18-4b71-94ab-37f6cfe01bc6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:43.100857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:43.102380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.102380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.102380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.103160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:43.106314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:43.145115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 940/1912] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:43.162234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:43.188168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797baf-1168-43cb-8c4c-64e456c7e42a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:43.201365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bce3ed-1ac5-423b-922f-b99f4dbe72ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:43.203594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce3ed-1ac5-423b-922f-b99f4dbe72ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.204116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce3ed-1ac5-423b-922f-b99f4dbe72ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.204799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bce3ed-1ac5-423b-922f-b99f4dbe72ba admin admin] PATH_INFO: `/v3/projects/c85eaa59ef2d436bac7dc15b98450dd6/users/6b68cfad4fb64aa290ac52f4030b1e6f/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.205465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bd04a-04e5-4340-8a6a-b554ba61ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:43.207889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bd04a-04e5-4340-8a6a-b554ba61ab23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.208836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bd04a-04e5-4340-8a6a-b554ba61ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.209708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bce3ed-1ac5-423b-922f-b99f4dbe72ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85eaa59ef2d436bac7dc15b98450dd6, user_id=6b68cfad4fb64aa290ac52f4030b1e6f, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:43.210664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bd04a-04e5-4340-8a6a-b554ba61ab23 admin admin] PATH_INFO: `/v3/projects/462c235ba058446c84de95d6e06b0325/users/43adffefee9e46afa64be124753a3a5a/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.218538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bce3ed-1ac5-423b-922f-b99f4dbe72ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:43.276245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 941/1913] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:43 2022] PUT /identity/v3/projects/c85eaa59ef2d436bac7dc15b98450dd6/users/6b68cfad4fb64aa290ac52f4030b1e6f/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:43.276578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bd04a-04e5-4340-8a6a-b554ba61ab23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462c235ba058446c84de95d6e06b0325, user_id=43adffefee9e46afa64be124753a3a5a, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:43.280078 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.281718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.281718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.284194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bd04a-04e5-4340-8a6a-b554ba61ab23 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:43.328875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] MFA Rules not processed for user `6b68cfad4fb64aa290ac52f4030b1e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:43.332739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:43.418713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 973/1914] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:42 2022] PUT /identity/v3/projects/462c235ba058446c84de95d6e06b0325/users/43adffefee9e46afa64be124753a3a5a/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:43.443854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.446561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.446561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.463742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:43.491882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] MFA Rules not processed for user `43adffefee9e46afa64be124753a3a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:43.494021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:43.559934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 942/1915] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:43.572249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:43.574283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:43.590776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 974/1916] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:43.599185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:43.601763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:43.696199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3f27-803a-4312-84ee-701bb6e40445 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:43.698438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd70e3-7c22-4b06-9fd3-8020c5bbe780 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:43.700325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c935a-b64d-405e-aa19-f865c09f4a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:43.701085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c935a-b64d-405e-aa19-f865c09f4a68 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.701490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c935a-b64d-405e-aa19-f865c09f4a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.701917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c935a-b64d-405e-aa19-f865c09f4a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.703117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:43.703909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:43.704658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:43.705151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:43.718624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:43.720454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:43.736968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 975/1917] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:43.788502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c935a-b64d-405e-aa19-f865c09f4a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:43.790131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c935a-b64d-405e-aa19-f865c09f4a68 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:43.808340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 943/1918] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:44.270224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:44.364024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:44.365703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:44.436718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036081-ad6d-4053-8c1f-6c6e8ab98035 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:44.450508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:44.453861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:44.453861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:44.453861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] PATH_INFO: `/v3/users/7c4bec23d9dd4b19b14016daf3390e0d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:44.456538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4bec23d9dd4b19b14016daf3390e0d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:44.458573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:44.662102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:44.721526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4bec23d9dd4b19b14016daf3390e0d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:44.800069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4bec23d9dd4b19b14016daf3390e0d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:44.800748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4bec23d9dd4b19b14016daf3390e0d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:44.801510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4bec23d9dd4b19b14016daf3390e0d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:44.820234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4bec23d9dd4b19b14016daf3390e0d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:44.837957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 976/1919] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:44 2022] DELETE /identity/v3/users/7c4bec23d9dd4b19b14016daf3390e0d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:44.842409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:44.842617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:44.842933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:44.868647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:44.869870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:44.940552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 944/1920] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:44.949567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:44.955752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:45.018926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0949-3d34-4174-98d5-3aa90bf5baa9 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:45.023137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262ecaf-2506-4aea-bf7b-fcef5abf862b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:45.023903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ecaf-2506-4aea-bf7b-fcef5abf862b service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:45.024014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ecaf-2506-4aea-bf7b-fcef5abf862b service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:45.024289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262ecaf-2506-4aea-bf7b-fcef5abf862b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:45.045935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262ecaf-2506-4aea-bf7b-fcef5abf862b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:45.047457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262ecaf-2506-4aea-bf7b-fcef5abf862b service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:45.058505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 977/1921] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:45.205700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:45.207120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:45.218760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5d46c-7024-492c-af97-e85791901c74 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:45.224081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:45.225047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:45.225326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:45.225620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] PATH_INFO: `/v3/users/00e05bf11e314d27b6f7e246826807db` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:45.226715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e05bf11e314d27b6f7e246826807db)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:45.228812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:45.276274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:45.407571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e05bf11e314d27b6f7e246826807db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:45.493465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e05bf11e314d27b6f7e246826807db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:45.494561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e05bf11e314d27b6f7e246826807db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:45.495259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e05bf11e314d27b6f7e246826807db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:45.505352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e05bf11e314d27b6f7e246826807db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:45.525243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 945/1922] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:45 2022] DELETE /identity/v3/users/00e05bf11e314d27b6f7e246826807db => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:45.529982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:45.530459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:45.530711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:45.559157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:45.560997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:45.561537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:45.563321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:45.697330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84937a-0e63-44d6-893d-3a30fe3ff24a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:45.702654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:45.705454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:45.706191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:45.732863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:45.732863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] PATH_INFO: `/v3/projects/0e3fb6b16ddb49d99d31f992c1df224a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:45.732863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3fb6b16ddb49d99d31f992c1df224a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:45.732863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:45.733329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 978/1923] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:45.735879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:45.737405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:45.807338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc27b6b-596f-4efa-afad-7d2f19545f25 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:45.811151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:45.811802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:45.812124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:45.812462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:45.830134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:45.830134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:45.838389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 979/1924] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:46.018248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3fb6b16ddb49d99d31f992c1df224a', 'request_id': 'req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.030198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3fb6b16ddb49d99d31f992c1df224a', 'request_id': 'req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.152884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3fb6b16ddb49d99d31f992c1df224a', 'request_id': 'req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.166082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] The token cache is being invalidate because project 0e3fb6b16ddb49d99d31f992c1df224a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:46.166457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.167220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.172676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 946/1925] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:45 2022] DELETE /identity/v3/projects/0e3fb6b16ddb49d99d31f992c1df224a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:46.173895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:46.186681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd214cd-3560-4677-bd57-21b918965260 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:46.283566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:46.284226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:46.284582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:46.284931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] PATH_INFO: `/v3/users/4410b537671143faaa6117a96f526767` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:46.286727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4410b537671143faaa6117a96f526767)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:46.289018 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:46.542988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4410b537671143faaa6117a96f526767'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.661613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4410b537671143faaa6117a96f526767'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.662418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4410b537671143faaa6117a96f526767'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.663245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4410b537671143faaa6117a96f526767'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.673367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4410b537671143faaa6117a96f526767'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:46.703512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 980/1926] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:46 2022] DELETE /identity/v3/users/4410b537671143faaa6117a96f526767 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:46.729895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:46.731506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:46.760151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7edd2-f6e0-4ff4-bb69-8d2e68026165 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:46.836518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:46.837292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:46.837642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:46.837984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] PATH_INFO: `/v3/projects/d3415d21a68a4556a2487e24b0888e56` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:46.839178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3415d21a68a4556a2487e24b0888e56)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:46.841197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:46.855620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:47.039474 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3415d21a68a4556a2487e24b0888e56', 'request_id': 'req-ad2fb581-c61a-443c-b341-f9352a0ef16a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.047630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3415d21a68a4556a2487e24b0888e56', 'request_id': 'req-ad2fb581-c61a-443c-b341-f9352a0ef16a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.101785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:47.136771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3415d21a68a4556a2487e24b0888e56', 'request_id': 'req-ad2fb581-c61a-443c-b341-f9352a0ef16a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.153085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] The token cache is being invalidate because project d3415d21a68a4556a2487e24b0888e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:47.153655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.154611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.157682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 947/1927] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:46 2022] DELETE /identity/v3/projects/d3415d21a68a4556a2487e24b0888e56 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:47.161512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:47.162993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:47.188009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98242bd-8804-4e51-a2f2-fa0f1b452630 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:47.263549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:47.264514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:47.266562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:47.266850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] PATH_INFO: `/v3/users/6b68cfad4fb64aa290ac52f4030b1e6f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:47.269900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b68cfad4fb64aa290ac52f4030b1e6f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:47.273137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:47.416017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:47.418048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:47.436092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb581-c61a-443c-b341-f9352a0ef16a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:47.441122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:47.442591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:47.442938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:47.443219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] PATH_INFO: `/v3/projects/2c8cb435eaa245468c41fadce4e7178f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:47.444479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8cb435eaa245468c41fadce4e7178f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:47.446456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:47.536568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b68cfad4fb64aa290ac52f4030b1e6f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.564910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8cb435eaa245468c41fadce4e7178f', 'request_id': 'req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.573405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8cb435eaa245468c41fadce4e7178f', 'request_id': 'req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.626703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b68cfad4fb64aa290ac52f4030b1e6f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.628036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b68cfad4fb64aa290ac52f4030b1e6f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.629476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b68cfad4fb64aa290ac52f4030b1e6f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.640755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edce4b4f-2014-494e-a9b7-d5cdcd0fdf1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b68cfad4fb64aa290ac52f4030b1e6f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.659094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 981/1928] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:47 2022] DELETE /identity/v3/users/6b68cfad4fb64aa290ac52f4030b1e6f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:47.772652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8cb435eaa245468c41fadce4e7178f', 'request_id': 'req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.789734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] The token cache is being invalidate because project 2c8cb435eaa245468c41fadce4e7178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:47.790490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.792248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d4e2017-c34a-4ef2-87b0-a1b176180a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:47.795093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 948/1929] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:47 2022] DELETE /identity/v3/projects/2c8cb435eaa245468c41fadce4e7178f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:47.801978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:47.802390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:47.802675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:47.828091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:47.833806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:47.924349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 982/1930] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:47.933167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:47.937156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:47.937156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:47.983879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:47.987124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:48.006883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 949/1931] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:48.008079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.023085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689231bf-54ab-42f1-a401-a44eeb3b2863 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.036911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.036911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.036911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.036911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.037317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:48.037317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.051588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.065491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 983/1932] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:48.070359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.081519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85cc3f-7ba7-4581-b61c-790528a8709e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.089068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.089697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.089982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.090258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.091739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.094318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.229655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 950/1933] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:48 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:48.235059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.237266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:48.243069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.262142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666c0d7-d684-4beb-8107-5f92f9ebeb67 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.362997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68396a4f-ef85-4c81-97fc-dbb83d9f38a1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.378608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.379342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.379611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.379939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.380627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.382562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.400113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.400961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.401202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.401523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] PATH_INFO: `/v3/projects/c85eaa59ef2d436bac7dc15b98450dd6` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.403838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85eaa59ef2d436bac7dc15b98450dd6)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.406673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.533219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 951/1934] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:48 2022] POST /identity/v3/users => generated 281 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:48.537558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.547763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811007-7728-44c0-b9ba-85152f33fda9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.553133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.553781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.554340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.554778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.555577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.557363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.570073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 952/1935] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:48.574223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.580111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85eaa59ef2d436bac7dc15b98450dd6', 'request_id': 'req-7d8dd767-9c08-4fc9-933d-1670921e437a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:48.587146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a347c5-bb28-4a8d-ab32-a3a110236a2c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.589280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85eaa59ef2d436bac7dc15b98450dd6', 'request_id': 'req-7d8dd767-9c08-4fc9-933d-1670921e437a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:48.651475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.652503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.652877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.653201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.653899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.655730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.676020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 953/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:48.680102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:48.693563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2d465-eb49-441e-8184-d856807e86f6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:48.699475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d56894-b48e-478f-9eec-8a5a7d5da58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:48.700399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d56894-b48e-478f-9eec-8a5a7d5da58b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.700725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d56894-b48e-478f-9eec-8a5a7d5da58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.701070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d56894-b48e-478f-9eec-8a5a7d5da58b admin admin] PATH_INFO: `/v3/projects/58b6932728f04fbe8f79fd3db47f49c2/users/712aef587aa649c58865fe48316da078/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.729665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85eaa59ef2d436bac7dc15b98450dd6', 'request_id': 'req-7d8dd767-9c08-4fc9-933d-1670921e437a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:48.734916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d56894-b48e-478f-9eec-8a5a7d5da58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b6932728f04fbe8f79fd3db47f49c2, user_id=712aef587aa649c58865fe48316da078, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:48.738868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d56894-b48e-478f-9eec-8a5a7d5da58b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:48.746863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] The token cache is being invalidate because project c85eaa59ef2d436bac7dc15b98450dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:48.747424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:48.748179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d8dd767-9c08-4fc9-933d-1670921e437a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:48.749803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 984/1937] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:48 2022] DELETE /identity/v3/projects/c85eaa59ef2d436bac7dc15b98450dd6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:48.755254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e050-0cf5-4d9f-9dcb-4d9783adc34a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.755548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e050-0cf5-4d9f-9dcb-4d9783adc34a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.755928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95e050-0cf5-4d9f-9dcb-4d9783adc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.801200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-ec95e050-0cf5-4d9f-9dcb-4d9783adc34a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:48.802717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ec95e050-0cf5-4d9f-9dcb-4d9783adc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:48.813233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 985/1938] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:48.819975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 954/1939] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:48 2022] PUT /identity/v3/projects/58b6932728f04fbe8f79fd3db47f49c2/users/712aef587aa649c58865fe48316da078/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:48.823469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.823469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.823664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.835278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:48.835490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:48.835660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:48.891414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] MFA Rules not processed for user `712aef587aa649c58865fe48316da078`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:48.892757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:48.916492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:48.916492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.060898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 986/1940] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:49.072411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.075738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683bed0-be30-4cd6-9ea6-9e10312756e8 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.087345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.088014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.088594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.088594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.089372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:49.089621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.091173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.092441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 955/1941] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:49.105861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 987/1942] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:49.112102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.126760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4ff7f-cc24-4c81-b2cd-e3c86d38e59d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.133161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.136168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.136281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.136281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.136281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.136281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.136831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.137721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.209941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a2a3f-c496-456a-acdc-4dda55235a71 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.213999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.214755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.215109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.215449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.225739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.227877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.234887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 956/1943] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:49 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:49.236343 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.240515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 988/1944] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:49.255397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.258123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.279591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fb6e-9393-4ecf-812c-74487a46f50f service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.334484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666ea3-62af-4c19-ae10-264cd7395dd9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.343592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.344214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.344517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.345765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.345893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.348965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.382374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.383012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.383294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.383570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] PATH_INFO: `/v3/users/712aef587aa649c58865fe48316da078` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.384748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712aef587aa649c58865fe48316da078)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.386644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.438216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 957/1945] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:49 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:49.442712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.452852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd68db-5f5f-415a-89cc-f0936c2d5f84 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.458075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.459008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.459403 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.460114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.460364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.461985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.472117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 958/1946] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:49.476585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.486436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9140e-585a-43c4-a7db-b873c1bac47d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.493611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.494286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.494576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.495129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.495785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.497760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.510405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 959/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:49.520254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.529922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ccdc9-2b0c-4ed8-abc2-38d9624b063d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.536136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef79194-f05b-4e5b-9e11-2e5f6df4787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.536822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79194-f05b-4e5b-9e11-2e5f6df4787c admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.537104 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79194-f05b-4e5b-9e11-2e5f6df4787c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.537385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef79194-f05b-4e5b-9e11-2e5f6df4787c admin admin] PATH_INFO: `/v3/projects/485d81b82dda4085be432e584af844c9/users/7217f01608f1426ca1792d993b256104/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.552925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef79194-f05b-4e5b-9e11-2e5f6df4787c admin admin] RBAC: Authorizing `identity:create_grant(project_id=485d81b82dda4085be432e584af844c9, user_id=7217f01608f1426ca1792d993b256104, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.555652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef79194-f05b-4e5b-9e11-2e5f6df4787c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.631547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712aef587aa649c58865fe48316da078'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:49.695113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712aef587aa649c58865fe48316da078'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:49.695741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712aef587aa649c58865fe48316da078'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:49.696382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712aef587aa649c58865fe48316da078'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:49.701392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 960/1948] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:49 2022] PUT /identity/v3/projects/485d81b82dda4085be432e584af844c9/users/7217f01608f1426ca1792d993b256104/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:49.703877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-4b283c26-d41d-4641-88f2-3dffc8fb2c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712aef587aa649c58865fe48316da078'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:49.714866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.715175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.715450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.731435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 989/1949] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:49 2022] DELETE /identity/v3/users/712aef587aa649c58865fe48316da078 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:49.736596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.736895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.737178 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.746556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] MFA Rules not processed for user `7217f01608f1426ca1792d993b256104`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:49.747780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.765718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:49.767126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.820138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 961/1950] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:49.833594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.835322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.843578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 990/1951] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:49.854192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:49.856159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:49.882961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:49.917066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:49.917221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecc71-3050-450e-8df8-d293db67cf4e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.932787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.932787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.932787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.932787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.933351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.933450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d51e-8ff6-4bd1-8efd-3832b5ae204b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:49.933543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.935626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db627a-95a6-408a-b8fd-f36519e59a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:49.936240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db627a-95a6-408a-b8fd-f36519e59a0a service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:49.937163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db627a-95a6-408a-b8fd-f36519e59a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:49.937357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db627a-95a6-408a-b8fd-f36519e59a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:49.948293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 962/1952] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:49.948444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db627a-95a6-408a-b8fd-f36519e59a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:49.949898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db627a-95a6-408a-b8fd-f36519e59a0a service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:49.960438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 991/1953] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:50.416575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:50.418961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:50.437719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68dfb-71b7-4cde-89b9-4bf57105a7a8 service glance] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:50.445010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:50.445652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:50.445935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:50.446213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] PATH_INFO: `/v3/projects/58b6932728f04fbe8f79fd3db47f49c2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:50.447394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b6932728f04fbe8f79fd3db47f49c2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:50.449384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:50.611757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b6932728f04fbe8f79fd3db47f49c2', 'request_id': 'req-7ac78697-d492-48bf-b12d-3812d796a62d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:50.624051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b6932728f04fbe8f79fd3db47f49c2', 'request_id': 'req-7ac78697-d492-48bf-b12d-3812d796a62d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:50.738904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b6932728f04fbe8f79fd3db47f49c2', 'request_id': 'req-7ac78697-d492-48bf-b12d-3812d796a62d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:50.753327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] The token cache is being invalidate because project 58b6932728f04fbe8f79fd3db47f49c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:50.753763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:50.754435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7ac78697-d492-48bf-b12d-3812d796a62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:50.758803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 963/1954] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:50 2022] DELETE /identity/v3/projects/58b6932728f04fbe8f79fd3db47f49c2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:50.761414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:50.762039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:50.762039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:50.783611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:50.784931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:50.845994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 992/1955] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:50.854095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:50.854542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:50.854638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:50.879929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:50.882079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:50.894947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 964/1956] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:50.898204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:50.908802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1e3cb-b0e7-4cee-8182-5f972baf2843 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:50.914876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:50.915527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:50.915832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:50.916127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:50.916780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:50.917144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:50.918883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:50.932751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 993/1957] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:50.937975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:50.953666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5e809-e0dc-4a51-99df-fea975a85f4c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:50.962232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:50.964744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:50.964744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:50.964744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:50.964744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:50.966157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.113258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 965/1958] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:50 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:51.117915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:51.127784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817128-4b64-47cc-ae05-b25c39bf852e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:51.206472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:51.207090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.207547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.207851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.209727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:51.212601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.269948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:51.344086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 994/1959] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:51 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:06:51.345728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:51.356055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d525-5adc-4010-97dc-ad0ae772459d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:51.361031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:51.361636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.361993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.362509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.373376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:51.374160 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.388357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 966/1960] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:51.390085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:51.402855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349b1d-1ee7-4c98-8196-d5d3b21a8477 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:51.406565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8130b2-c9d7-429e-b62d-f6fcdb602825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:51.407177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8130b2-c9d7-429e-b62d-f6fcdb602825 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.407451 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8130b2-c9d7-429e-b62d-f6fcdb602825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.408414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8130b2-c9d7-429e-b62d-f6fcdb602825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.408738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8130b2-c9d7-429e-b62d-f6fcdb602825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:51.410511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8130b2-c9d7-429e-b62d-f6fcdb602825 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.428489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 995/1961] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:06:51.429877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:51.456333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff60c-25f8-432a-ad63-ee5f96b63313 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:51.456333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:51.457099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.457609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.458345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] PATH_INFO: `/v3/projects/9da3212a162b4d6b95f8820f01df3df1/users/a59025fe895e489991d91c37fdb0a8be/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.476719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da3212a162b4d6b95f8820f01df3df1, user_id=a59025fe895e489991d91c37fdb0a8be, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:51.479846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.558807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 967/1962] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:51 2022] PUT /identity/v3/projects/9da3212a162b4d6b95f8820f01df3df1/users/a59025fe895e489991d91c37fdb0a8be/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:51.569951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.570221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.570868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.606782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] MFA Rules not processed for user `a59025fe895e489991d91c37fdb0a8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:51.608666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:51.699361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 996/1963] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:51.699628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:51.701427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:51.711970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:51.713455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:51.753483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:51.794561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859331c1-7dac-44d1-9e44-62b57c39199f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:51.803755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:51.803755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.804123 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.804603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] PATH_INFO: `/v3/users/43adffefee9e46afa64be124753a3a5a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.806164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=43adffefee9e46afa64be124753a3a5a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:51.808632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.838073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d210-d5d2-43ae-93da-a1f2dfe5fbcf None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:51.850522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a006a-f87c-48a1-a540-8e60838cc66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:51.851324 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a006a-f87c-48a1-a540-8e60838cc66e service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:51.852387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a006a-f87c-48a1-a540-8e60838cc66e service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:51.853159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a006a-f87c-48a1-a540-8e60838cc66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:51.863512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a006a-f87c-48a1-a540-8e60838cc66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:51.866685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a006a-f87c-48a1-a540-8e60838cc66e service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:51.876796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 997/1964] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:06:52.074133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43adffefee9e46afa64be124753a3a5a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:52.169588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43adffefee9e46afa64be124753a3a5a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:52.170570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43adffefee9e46afa64be124753a3a5a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:52.171892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43adffefee9e46afa64be124753a3a5a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:52.193792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43adffefee9e46afa64be124753a3a5a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:52.212674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 968/1965] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:51 2022] DELETE /identity/v3/users/43adffefee9e46afa64be124753a3a5a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:52.227634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:52.227634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:52.227634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:52.242793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:52.244168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:52.311339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 998/1966] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:52.328171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:52.330704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:52.404302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8acf-081e-4ef0-8aa4-643533cda9da admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:52.408331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e7edc-f294-4f16-b123-4679542018c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:52.409030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7edc-f294-4f16-b123-4679542018c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:52.409401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7edc-f294-4f16-b123-4679542018c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:52.409744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7edc-f294-4f16-b123-4679542018c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:52.420613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e7edc-f294-4f16-b123-4679542018c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:52.422238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e7edc-f294-4f16-b123-4679542018c9 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:52.434639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 969/1967] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:52.994976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:53.056273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:53.363344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:53.365430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:53.385107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958689d7-97c3-45ed-a218-6f1d887ccb63 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:53.398454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:53.399114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:53.399616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:53.400086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] PATH_INFO: `/v3/projects/462c235ba058446c84de95d6e06b0325` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:53.405369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=462c235ba058446c84de95d6e06b0325)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:53.408422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:53.604030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462c235ba058446c84de95d6e06b0325', 'request_id': 'req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:53.620557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462c235ba058446c84de95d6e06b0325', 'request_id': 'req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:53.709903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462c235ba058446c84de95d6e06b0325', 'request_id': 'req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:53.766880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] The token cache is being invalidate because project 462c235ba058446c84de95d6e06b0325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:53.767805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:53.768774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0a7585d3-bbae-49bf-b593-079ed4ebf1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:53.777181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 999/1968] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:53 2022] DELETE /identity/v3/projects/462c235ba058446c84de95d6e06b0325 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:53.787328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:53.787973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:53.787973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:53.813167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:53.814690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:53.925360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 970/1969] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:53.932716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:53.933294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:53.933782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:53.975086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:53.977241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:53.987138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1000/1970] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:53.992693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:54.006277 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6d1b-491e-4187-a86a-69df5c87d0ac None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:54.019684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:54.022782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.023139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.023485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.025488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:54.025888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:54.029955 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:54.064450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 971/1971] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:54.068964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:54.078322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eeff2-b7d0-4cd6-8528-1c9c088c6363 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:54.084212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:54.084922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.085215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.085554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.086364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:54.088553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:54.240815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1001/1972] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:54 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:54.245086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:54.260361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07302a5a-0291-401b-9eac-9fd79f082ca7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:54.266814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:54.295358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:54.371065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:54.371804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.372155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.372529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.373578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:54.376982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:54.556213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 972/1973] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:54 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:06:54.558476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:54.573063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1d91-cdde-442f-9264-39738242abc8 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:54.585638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:54.585638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.585638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.585638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.586455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:54.586455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:54.611357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1002/1974] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:54.623127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:54.639347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea9ba8-5602-4281-b4b3-c69ce8eb785b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:54.657998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202b2bc-25fa-4c17-a29a-1263f78d8445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:54.662051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202b2bc-25fa-4c17-a29a-1263f78d8445 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.662607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202b2bc-25fa-4c17-a29a-1263f78d8445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.663158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202b2bc-25fa-4c17-a29a-1263f78d8445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.663987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202b2bc-25fa-4c17-a29a-1263f78d8445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:54.666681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202b2bc-25fa-4c17-a29a-1263f78d8445 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:54.691562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:54.692978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 973/1975] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:54.717842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d33886-c578-4d3a-9dd5-078d17ecb44a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:54.727400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:54.729291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.729791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.731428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] PATH_INFO: `/v3/projects/f6f1ff392a50451dbe0326d775d9a3aa/users/53e81b481f9f43b29268f38bd9894a02/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.773819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f1ff392a50451dbe0326d775d9a3aa, user_id=53e81b481f9f43b29268f38bd9894a02, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:54.789597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:54.887885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1003/1976] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:54 2022] PUT /identity/v3/projects/f6f1ff392a50451dbe0326d775d9a3aa/users/53e81b481f9f43b29268f38bd9894a02/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:06:54.888904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:54.888904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:54.888904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:54.947810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] MFA Rules not processed for user `53e81b481f9f43b29268f38bd9894a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:54.950410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:55.144550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 974/1977] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:55.198880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:55.200802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:55.292099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e73921-60db-4855-ba14-ab2ee5f1ae6f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:55.296701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5a913-2f50-4aa8-ac74-d84d7cd98e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:55.297566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a913-2f50-4aa8-ac74-d84d7cd98e34 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:55.298149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a913-2f50-4aa8-ac74-d84d7cd98e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:55.298431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5a913-2f50-4aa8-ac74-d84d7cd98e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:55.304769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:55.313126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5a913-2f50-4aa8-ac74-d84d7cd98e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:55.314826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5a913-2f50-4aa8-ac74-d84d7cd98e34 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:55.327501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1004/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:55.884419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:56.454240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:57.568489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:57.571178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:57.691394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65086-7570-438d-8df4-c8e4c6b540bf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:57.699613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:57.711589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:57.711589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:57.711589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] PATH_INFO: `/v3/users/a59025fe895e489991d91c37fdb0a8be` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:57.711589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59025fe895e489991d91c37fdb0a8be)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:57.711589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:57.734459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:57.821639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:57.919742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59025fe895e489991d91c37fdb0a8be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:58.044841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59025fe895e489991d91c37fdb0a8be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:58.045045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59025fe895e489991d91c37fdb0a8be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:58.045692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59025fe895e489991d91c37fdb0a8be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:58.058844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59025fe895e489991d91c37fdb0a8be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:58.097658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 975/1979] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:06:57 2022] DELETE /identity/v3/users/a59025fe895e489991d91c37fdb0a8be => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:58.102063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:58.102352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:58.102703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:58.132484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:58.134343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:58.252559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1005/1980] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:58.263821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:58.266301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:58.313086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:58.371747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028dc33-33fc-42e5-8c11-ae8281419e60 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:58.377074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45b2f9-ebbd-47a9-b649-f99835efe85d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:58.377820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b2f9-ebbd-47a9-b649-f99835efe85d service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:58.380038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b2f9-ebbd-47a9-b649-f99835efe85d service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:58.380038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b2f9-ebbd-47a9-b649-f99835efe85d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:58.390710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b2f9-ebbd-47a9-b649-f99835efe85d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:58.392359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b2f9-ebbd-47a9-b649-f99835efe85d service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:58.408571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 976/1981] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:06:58.914091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:58.915584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:58.933268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:58.939684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf752f16-f74f-4608-8797-e07d4dab3043 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:58.946491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:58.947133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:58.947416 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:58.947694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] PATH_INFO: `/v3/projects/9da3212a162b4d6b95f8820f01df3df1` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:58.948900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da3212a162b4d6b95f8820f01df3df1)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:58.950958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.084880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da3212a162b4d6b95f8820f01df3df1', 'request_id': 'req-d70dad95-e586-4d6d-a665-273cb1461693'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:59.091046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da3212a162b4d6b95f8820f01df3df1', 'request_id': 'req-d70dad95-e586-4d6d-a665-273cb1461693'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:59.197026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da3212a162b4d6b95f8820f01df3df1', 'request_id': 'req-d70dad95-e586-4d6d-a665-273cb1461693'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:59.208680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] The token cache is being invalidate because project 9da3212a162b4d6b95f8820f01df3df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:06:59.208890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:59.209526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d70dad95-e586-4d6d-a665-273cb1461693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:06:59.211020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1006/1982] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:06:58 2022] DELETE /identity/v3/projects/9da3212a162b4d6b95f8820f01df3df1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:59.215939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.216406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.216635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.236058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:59.237285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:59.310446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 977/1983] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:06:59.320449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.320744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.321030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.341723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:59.342973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:06:59.351672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1007/1984] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:06:59.356174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:59.367218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94c83d-601a-4fcb-9ec8-d84b5366e022 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:59.371757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:59.372427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.372711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.373129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.373742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:06:59.374047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:59.375638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.389094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 978/1985] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:06:59.392990 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:59.402721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b2d62-ab3a-42c3-9da1-fbe8812d7994 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:59.407485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:59.408088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.408405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.408682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.409323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:59.411689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.444015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:59.522448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1008/1986] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:06:59 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:59.526680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:59.537721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856e93-d157-4454-b4dc-b4b4ad9112d4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:59.597516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:59.598840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.599199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.599478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.600127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:59.602077 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.698749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 979/1987] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:06:59 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:06:59.702994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:59.714046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c8c8-cc99-49bd-bc9b-5d2398d34786 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:59.718703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:59.719307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.719606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.719860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.720536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:59.722113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.732802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1009/1988] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:59.736750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:59.748885 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3f0b-3e38-4724-9fe2-2329f4528b0a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:59.753822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ab374-fb37-4a89-b14c-d1e3bb624885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:59.754976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ab374-fb37-4a89-b14c-d1e3bb624885 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.755471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ab374-fb37-4a89-b14c-d1e3bb624885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.755906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ab374-fb37-4a89-b14c-d1e3bb624885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.756591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ab374-fb37-4a89-b14c-d1e3bb624885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:59.758181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ab374-fb37-4a89-b14c-d1e3bb624885 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.769113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 980/1989] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:06:59.774229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:06:59.784235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722472-dbbd-45ab-b4d1-95987c944595 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:06:59.789088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:06:59.789761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.790058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.790333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] PATH_INFO: `/v3/projects/16fb7395a1994021afdb88aa5a1296ca/users/83bfab85faad4c93b2931a9b0c32f35c/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.801737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:06:59.810390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16fb7395a1994021afdb88aa5a1296ca, user_id=83bfab85faad4c93b2931a9b0c32f35c, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:06:59.812941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:06:59.881523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1010/1990] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:06:59 2022] PUT /identity/v3/projects/16fb7395a1994021afdb88aa5a1296ca/users/83bfab85faad4c93b2931a9b0c32f35c/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:06:59.895818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:06:59.895818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:06:59.895818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:06:59.929854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] MFA Rules not processed for user `83bfab85faad4c93b2931a9b0c32f35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:06:59.930580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:00.010847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 981/1991] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:00.022029 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.043363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:00.099774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e9c3f-acd9-4471-b2e5-39a74c676c54 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:00.104592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:00.105272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.105470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.105748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.110391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:00.110391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:00.221896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1011/1992] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:00 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:00.226524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.238220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56225c-1aa3-4dd9-8725-4330a2b4122d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:00.295211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:00.295734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.296013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.296287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.297022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:00.298934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:00.395626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:00.401449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 982/1993] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:00 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:00.405352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.416530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26cf37-cb8f-49a3-b00d-c46c375f74a6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:00.421295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:00.426215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.426215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.426215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.426215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:00.426215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:00.437916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1012/1994] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:00.442971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.455216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26bca-5a1c-4e20-ad5b-c8ac0797c77d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:00.458926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b5f07-570a-40ef-9d90-7bc1deaddf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:00.459526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b5f07-570a-40ef-9d90-7bc1deaddf19 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.459802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b5f07-570a-40ef-9d90-7bc1deaddf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.460074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b5f07-570a-40ef-9d90-7bc1deaddf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.460739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b5f07-570a-40ef-9d90-7bc1deaddf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:00.462402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b5f07-570a-40ef-9d90-7bc1deaddf19 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:00.472361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 983/1995] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:00.477594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.498770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8057b-9fc3-429d-8ee4-17e354e64a9d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:00.512077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:00.513161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.513486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.513776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] PATH_INFO: `/v3/projects/31c54611a7014d58a781abd2f05a90b5/users/8005fc14c1474976a4e7b80e6e84f4f5/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.533332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c54611a7014d58a781abd2f05a90b5, user_id=8005fc14c1474976a4e7b80e6e84f4f5, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:00.536430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:00.641403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1013/1996] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:00 2022] PUT /identity/v3/projects/31c54611a7014d58a781abd2f05a90b5/users/8005fc14c1474976a4e7b80e6e84f4f5/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:00.652490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.652781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.653062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.686412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] MFA Rules not processed for user `8005fc14c1474976a4e7b80e6e84f4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:00.687642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:00.694415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:00.761975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 984/1997] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:00.766721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.836638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47480240-8ec1-4443-8503-32cf7f578f87 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:00.841405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:00.842072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:00.842352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:00.842627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:00.843299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:00.845290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:00.955523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1014/1998] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:00 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:00.960485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:00.971417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5aaf4-9ee0-44bd-becc-e7aef32be13a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:01.032537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:01.040817 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:01.041514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.041909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.042171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.042863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:01.045004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:01.077871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:01.144080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 985/1999] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:00 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:01.146476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:01.158822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2261386-ff2e-4ba3-ac2f-2a59d73a8678 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:01.164865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:01.165485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.168146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.168146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.168146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:01.168902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:01.185005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1015/2000] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:01.186239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:01.197490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb6c6-c12c-4d02-975c-6576de3b41e5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:01.203153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:01.203959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.204351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.204741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] PATH_INFO: `/v3/projects/619734ed8cff4ae8b7ce779f379e21d7/users/5b4c7a9a112c46eeaaee454ffde89f52/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.226284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619734ed8cff4ae8b7ce779f379e21d7, user_id=5b4c7a9a112c46eeaaee454ffde89f52, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:01.229046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:01.312608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 986/2001] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:01 2022] PUT /identity/v3/projects/619734ed8cff4ae8b7ce779f379e21d7/users/5b4c7a9a112c46eeaaee454ffde89f52/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:01.323653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:01.334362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524c2f6-5104-4a0d-87ac-f7912c98aaff admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:01.392597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0989a-052e-4f49-9a93-686a474ca3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:01.393255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0989a-052e-4f49-9a93-686a474ca3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.393534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0989a-052e-4f49-9a93-686a474ca3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.393813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0989a-052e-4f49-9a93-686a474ca3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.394447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0989a-052e-4f49-9a93-686a474ca3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:01.396529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0989a-052e-4f49-9a93-686a474ca3b7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:01.406591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1016/2002] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:01.412198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:01.425893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207bbe-f103-42c0-91e8-c8de0b9fd8f0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:01.431598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:01.432285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.432598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.432875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] PATH_INFO: `/v3/projects/619734ed8cff4ae8b7ce779f379e21d7/users/5b4c7a9a112c46eeaaee454ffde89f52/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.434875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=619734ed8cff4ae8b7ce779f379e21d7, user_id=5b4c7a9a112c46eeaaee454ffde89f52, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:01.437535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:01.448917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 987/2003] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:01 2022] PUT /identity/v3/projects/619734ed8cff4ae8b7ce779f379e21d7/users/5b4c7a9a112c46eeaaee454ffde89f52/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:01.460361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.463812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.463812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.492248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] MFA Rules not processed for user `5b4c7a9a112c46eeaaee454ffde89f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:01.493489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:01.564698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1017/2004] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:01.577009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:01.578813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:01.670738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191736d-0ed2-4dbd-afeb-7a9df05acb3d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:01.675235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:01.675963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:01.676983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:01.677558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:01.686681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:01.751825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:01.795559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:01.797533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:01.813173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 988/2005] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:02.223717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:02.390628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:02.618791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:02.814818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:03.018664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:03.431678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:03.617926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:03.678288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:03.924908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:03.938446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e181-360f-4b0d-a882-b8d10979c90f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:03.942299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:04.058920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:04.058920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:04.058920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:04.058920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:04.058920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:04.058920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1018/2006] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:04.076987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:05.711612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:05.723021 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25f988-f155-454d-afc3-d6efe30e4b87 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:05.727811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4295b-f3fc-4585-a98b-eadb5096f545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:05.728458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4295b-f3fc-4585-a98b-eadb5096f545 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:05.728788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4295b-f3fc-4585-a98b-eadb5096f545 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:05.729068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4295b-f3fc-4585-a98b-eadb5096f545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:05.738623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4295b-f3fc-4585-a98b-eadb5096f545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:05.740807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4295b-f3fc-4585-a98b-eadb5096f545 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:05.750350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 989/2007] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:08.805916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:08.808355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:08.910384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df4d0-3f42-4784-bcd9-f895b631b4d5 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:08.921003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:08.921003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:08.921003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:08.921296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] PATH_INFO: `/v3/users/53e81b481f9f43b29268f38bd9894a02` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:08.922383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e81b481f9f43b29268f38bd9894a02)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:08.924425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:09.114341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:09.123291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e81b481f9f43b29268f38bd9894a02'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:09.185276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e81b481f9f43b29268f38bd9894a02'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:09.185847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e81b481f9f43b29268f38bd9894a02'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:09.186445 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e81b481f9f43b29268f38bd9894a02'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:09.203103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e81b481f9f43b29268f38bd9894a02'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:09.214788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1019/2008] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:08 2022] DELETE /identity/v3/users/53e81b481f9f43b29268f38bd9894a02 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:09.219330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:09.219816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:09.219910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:09.244461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:09.246002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:09.320589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 990/2009] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:09.332389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:09.335148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:09.412417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a707c7-4899-4030-a535-baad238b6d1b admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:09.416420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ca5d-4f35-4e2a-9b7c-cba33d79564d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:09.416868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ca5d-4f35-4e2a-9b7c-cba33d79564d service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:09.417223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ca5d-4f35-4e2a-9b7c-cba33d79564d service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:09.417572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ca5d-4f35-4e2a-9b7c-cba33d79564d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:09.428093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ca5d-4f35-4e2a-9b7c-cba33d79564d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:09.432381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956ca5d-4f35-4e2a-9b7c-cba33d79564d service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:09.450627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1020/2010] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:09.971315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:09.976482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:10.002247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afead3c-fd59-44ec-add6-ba2a1208f68d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:10.008411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:10.009121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.009395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.009728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] PATH_INFO: `/v3/projects/f6f1ff392a50451dbe0326d775d9a3aa` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.010906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f1ff392a50451dbe0326d775d9a3aa)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:10.013189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:10.187099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:10.197241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f1ff392a50451dbe0326d775d9a3aa', 'request_id': 'req-4077cd08-d377-4720-a1a0-80884cf98050'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:10.215924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f1ff392a50451dbe0326d775d9a3aa', 'request_id': 'req-4077cd08-d377-4720-a1a0-80884cf98050'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:10.305635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f1ff392a50451dbe0326d775d9a3aa', 'request_id': 'req-4077cd08-d377-4720-a1a0-80884cf98050'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:10.317574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] The token cache is being invalidate because project f6f1ff392a50451dbe0326d775d9a3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:10.320171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:10.320171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4077cd08-d377-4720-a1a0-80884cf98050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:10.320171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 991/2011] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:09 2022] DELETE /identity/v3/projects/f6f1ff392a50451dbe0326d775d9a3aa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:10.531005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25370ce5-48de-450c-86f9-498ac4b2b46d None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.531548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25370ce5-48de-450c-86f9-498ac4b2b46d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.531663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25370ce5-48de-450c-86f9-498ac4b2b46d None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.533341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1021/2012] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:07:10.562139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45684ab-de82-4580-8dea-a3ca28fe7b04 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.562624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45684ab-de82-4580-8dea-a3ca28fe7b04 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.562908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45684ab-de82-4580-8dea-a3ca28fe7b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.596027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d45684ab-de82-4580-8dea-a3ca28fe7b04 None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:10.597414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d45684ab-de82-4580-8dea-a3ca28fe7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:10.689396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25370ce5-48de-450c-86f9-498ac4b2b46d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:10.689396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-25370ce5-48de-450c-86f9-498ac4b2b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:10.721396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 992/2013] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:07:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:10.789815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b120a-aca7-49a0-9567-114ba0969411 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.790435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b120a-aca7-49a0-9567-114ba0969411 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.790932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b120a-aca7-49a0-9567-114ba0969411 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.792473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25370ce5-48de-450c-86f9-498ac4b2b46d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:10.792743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 993/2014] 10.222.0.26 () {54 vars in 961 bytes} [Thu Sep 15 11:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 11:07:10.798136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.798419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.798807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.803330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:10.804169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.804619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.805065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] PATH_INFO: `/v3/users/0eac81d7fb9b4a58ae8023bfd5709d9f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.806486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eac81d7fb9b4a58ae8023bfd5709d9f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:10.808716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:10.825059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:10.826668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:10.839346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 994/2015] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Sep 15 11:07:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:10.841511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:10.849932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:10.858394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096c58b-e91e-4498-a80d-41464c5516fd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:10.864941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:10.865589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:10.865876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:10.866155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] PATH_INFO: `/v3/users/83bfab85faad4c93b2931a9b0c32f35c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:10.867365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bfab85faad4c93b2931a9b0c32f35c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:10.869865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.046289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eac81d7fb9b4a58ae8023bfd5709d9f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.067573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bfab85faad4c93b2931a9b0c32f35c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.111176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eac81d7fb9b4a58ae8023bfd5709d9f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.111800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eac81d7fb9b4a58ae8023bfd5709d9f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.112516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eac81d7fb9b4a58ae8023bfd5709d9f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.119412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:11.121492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eac81d7fb9b4a58ae8023bfd5709d9f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.138538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1022/2016] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:10 2022] DELETE /identity/v3/users/0eac81d7fb9b4a58ae8023bfd5709d9f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:11.139322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:11.140669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.174042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bfab85faad4c93b2931a9b0c32f35c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.174731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bfab85faad4c93b2931a9b0c32f35c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.175379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bfab85faad4c93b2931a9b0c32f35c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.188150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a9c0b5c-ce07-4da3-a939-2fdbdd208ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bfab85faad4c93b2931a9b0c32f35c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.208774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 995/2017] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:10 2022] DELETE /identity/v3/users/83bfab85faad4c93b2931a9b0c32f35c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:11.214032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.214325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.215037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.219125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2df667-48dd-4bc5-9ff1-7f7abf20e755 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:11.242590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:11.243795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.291863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:11.303606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:11.305129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.310197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.310197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.310197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.337681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:11.339416 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.350401 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1023/2018] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:11.358257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 996/2019] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:11.368588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:11.370242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.428177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:11.435258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.435527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b1342-f912-413a-8a24-8abc5a5fdb0e service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:11.437244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955cecf-c308-4b06-a1a1-31a2cdc7706a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:11.437923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955cecf-c308-4b06-a1a1-31a2cdc7706a service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.438203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955cecf-c308-4b06-a1a1-31a2cdc7706a service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.438480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955cecf-c308-4b06-a1a1-31a2cdc7706a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.448281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955cecf-c308-4b06-a1a1-31a2cdc7706a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:11.449597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c4ea-b743-4761-8f11-bb8ecfd644b5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:11.449709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955cecf-c308-4b06-a1a1-31a2cdc7706a service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.456007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:11.458356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.458356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.458356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] PATH_INFO: `/v3/projects/98a75b0c21f042539f22274a5eab66f1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.459893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a75b0c21f042539f22274a5eab66f1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:11.461368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1024/2020] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:11.462591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.590893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a75b0c21f042539f22274a5eab66f1', 'request_id': 'req-06d44cee-9ae7-475e-9237-601a5fcf00fb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.597371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a75b0c21f042539f22274a5eab66f1', 'request_id': 'req-06d44cee-9ae7-475e-9237-601a5fcf00fb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.653840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a75b0c21f042539f22274a5eab66f1', 'request_id': 'req-06d44cee-9ae7-475e-9237-601a5fcf00fb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.666139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] The token cache is being invalidate because project 98a75b0c21f042539f22274a5eab66f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:11.666429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.667094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06d44cee-9ae7-475e-9237-601a5fcf00fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:11.668918 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 997/2021] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:11 2022] DELETE /identity/v3/projects/98a75b0c21f042539f22274a5eab66f1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:11.673995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.674444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.674663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.696330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:11.697547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.706382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:11.761325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1025/2022] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:11.768270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.768621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.768899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.790539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:11.791767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.803349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 998/2023] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:11.807434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:11.817858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0488-e940-43ea-9a71-967d7d14b043 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:11.822587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:11.823185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.823461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.823732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.824407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:07:11.824709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:11.826280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.838429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1026/2024] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:07:11.842759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:11.852817 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca3429-38e6-4ee5-9507-f6e93559d18a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:11.857719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:11.858313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.858611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.858890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.859523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:11.861524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.876658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:11.878543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:11.900398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c659a-a0f0-4ad4-88b5-d354b1936b68 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:11.913168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:11.913815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:11.914096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:11.914371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] PATH_INFO: `/v3/projects/16fb7395a1994021afdb88aa5a1296ca` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:11.915639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16fb7395a1994021afdb88aa5a1296ca)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:11.917582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:11.967579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 999/2025] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:11 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:11.971698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:12.043064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff026a-ea05-4497-b709-11d7871cd2b4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:12.056709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16fb7395a1994021afdb88aa5a1296ca', 'request_id': 'req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.063560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16fb7395a1994021afdb88aa5a1296ca', 'request_id': 'req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.075744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:12.108848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:12.109575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.109854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.110130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.110777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:12.112756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:12.137229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16fb7395a1994021afdb88aa5a1296ca', 'request_id': 'req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.148333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] The token cache is being invalidate because project 16fb7395a1994021afdb88aa5a1296ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:12.148630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.149262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.150758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1027/2026] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:11 2022] DELETE /identity/v3/projects/16fb7395a1994021afdb88aa5a1296ca => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:12.154687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:12.155969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:12.168696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08dd7-159a-4b2c-b35b-aec4ffdd3445 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:12.173471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:12.174102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.174378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.174674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] PATH_INFO: `/v3/users/8005fc14c1474976a4e7b80e6e84f4f5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.175782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8005fc14c1474976a4e7b80e6e84f4f5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:12.178291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:12.219812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1000/2027] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:11 2022] POST /identity/v3/users => generated 281 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:07:12.223992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:12.226212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:12.238202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473eff9-1532-4345-93e5-7b628830bc1b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:12.243795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:12.244424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.244727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.251008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.251008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:12.251008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:12.258191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1001/2028] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:12.261952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:12.271451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0e610-8d06-4516-86c7-3f2cbbafc6b3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:12.276008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:12.276608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.279778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.279778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.279778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:12.279778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:12.289367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1002/2029] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:12.293154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:12.304369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d901b4-bc6a-4c65-9e60-053fa285ab15 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:12.309234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b02b3-39f2-422f-9cdc-ff5ebbf5abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:12.309867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b02b3-39f2-422f-9cdc-ff5ebbf5abad admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.310147 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b02b3-39f2-422f-9cdc-ff5ebbf5abad admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.310422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b02b3-39f2-422f-9cdc-ff5ebbf5abad admin admin] PATH_INFO: `/v3/projects/f627ba12693f422db2f9b07e416f5b70/users/b1d69f5b53604de8a12f062639fffa23/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.326006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b02b3-39f2-422f-9cdc-ff5ebbf5abad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f627ba12693f422db2f9b07e416f5b70, user_id=b1d69f5b53604de8a12f062639fffa23, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:12.328687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b02b3-39f2-422f-9cdc-ff5ebbf5abad admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:12.421529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8005fc14c1474976a4e7b80e6e84f4f5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.436658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1003/2030] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:12 2022] PUT /identity/v3/projects/f627ba12693f422db2f9b07e416f5b70/users/b1d69f5b53604de8a12f062639fffa23/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:12.447285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.447701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.448028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.476210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] MFA Rules not processed for user `b1d69f5b53604de8a12f062639fffa23`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:12.477443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:12.531087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8005fc14c1474976a4e7b80e6e84f4f5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.531708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8005fc14c1474976a4e7b80e6e84f4f5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.532531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8005fc14c1474976a4e7b80e6e84f4f5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.540865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8005fc14c1474976a4e7b80e6e84f4f5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:12.546548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1004/2031] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:12.555155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:12.556518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:12.557536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:12.564415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1028/2032] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:12 2022] DELETE /identity/v3/users/8005fc14c1474976a4e7b80e6e84f4f5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:12.622516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922bda6-cf5e-4d62-b682-a45c180a7842 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:12.635421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:12.677069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:12.677069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:12.677069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:12.677069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:12.677551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:12.736174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:12.737671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:12.746718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1005/2033] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:07:13.010739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:13.013150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:13.089820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281a819-8e6f-444a-ab64-3e9e3a13e829 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:13.094421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:13.095045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:13.095323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:13.095593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] PATH_INFO: `/v3/projects/31c54611a7014d58a781abd2f05a90b5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:13.096737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c54611a7014d58a781abd2f05a90b5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:13.099319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:13.227435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c54611a7014d58a781abd2f05a90b5', 'request_id': 'req-69737afd-5600-4cfe-9914-5358e87878e9'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.234480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c54611a7014d58a781abd2f05a90b5', 'request_id': 'req-69737afd-5600-4cfe-9914-5358e87878e9'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.317107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c54611a7014d58a781abd2f05a90b5', 'request_id': 'req-69737afd-5600-4cfe-9914-5358e87878e9'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.332044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] The token cache is being invalidate because project 31c54611a7014d58a781abd2f05a90b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:13.332381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.333194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.334740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1029/2034] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:13 2022] DELETE /identity/v3/projects/31c54611a7014d58a781abd2f05a90b5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:13.338725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:13.350129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fc6d0-d04c-4483-ada8-de518ff72241 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:13.407513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:13.408139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:13.408603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:13.408839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] PATH_INFO: `/v3/users/5b4c7a9a112c46eeaaee454ffde89f52` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:13.409966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4c7a9a112c46eeaaee454ffde89f52)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:13.412804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:13.619743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4c7a9a112c46eeaaee454ffde89f52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.731658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4c7a9a112c46eeaaee454ffde89f52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.732700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4c7a9a112c46eeaaee454ffde89f52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.733627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4c7a9a112c46eeaaee454ffde89f52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.742484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-29146b7b-9350-4f69-8a00-8a311417527e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4c7a9a112c46eeaaee454ffde89f52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:13.749583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:13.760582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1006/2035] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:13 2022] DELETE /identity/v3/users/5b4c7a9a112c46eeaaee454ffde89f52 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:14.187081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:14.188598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:14.207329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737afd-5600-4cfe-9914-5358e87878e9 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:14.268626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:14.269356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.269831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.269958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] PATH_INFO: `/v3/projects/619734ed8cff4ae8b7ce779f379e21d7` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.272225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619734ed8cff4ae8b7ce779f379e21d7)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:14.274283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:14.368481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:14.386337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619734ed8cff4ae8b7ce779f379e21d7', 'request_id': 'req-043208fd-5181-4a49-b7bd-0bc0ad3eed60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:14.393585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619734ed8cff4ae8b7ce779f379e21d7', 'request_id': 'req-043208fd-5181-4a49-b7bd-0bc0ad3eed60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:14.447998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619734ed8cff4ae8b7ce779f379e21d7', 'request_id': 'req-043208fd-5181-4a49-b7bd-0bc0ad3eed60'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:14.459851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] The token cache is being invalidate because project 619734ed8cff4ae8b7ce779f379e21d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:14.460145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:14.460836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-043208fd-5181-4a49-b7bd-0bc0ad3eed60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:14.462330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1030/2036] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:14 2022] DELETE /identity/v3/projects/619734ed8cff4ae8b7ce779f379e21d7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:14.467136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e108529-37fe-4170-b712-31893c65a161 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.467429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e108529-37fe-4170-b712-31893c65a161 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.467711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e108529-37fe-4170-b712-31893c65a161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.488144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8e108529-37fe-4170-b712-31893c65a161 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:14.489387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8e108529-37fe-4170-b712-31893c65a161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:14.550379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1007/2037] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:14.558445 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.558729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.559003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.583411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:14.583411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:14.589996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1031/2038] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:14.594326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e108529-37fe-4170-b712-31893c65a161 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:14.604710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e108529-37fe-4170-b712-31893c65a161 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:14.609984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:14.610168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.610451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.610727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.611372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:07:14.611672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:14.613281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:14.625550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1008/2039] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:07:14.630584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:14.640383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e765-fab4-4c42-8a2a-26cd8d223fbf None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:14.645576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:14.646360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.646698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.646916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.647552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:14.649491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:14.748237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1032/2040] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:14 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:14.752610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:14.762658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd765e-0aab-4684-820a-c651cd23d86e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:14.821655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:14.822259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.822537 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.822812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.823812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:14.825434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:14.931535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1009/2041] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:14 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:07:14.932851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:14.943816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b6091-2167-4bac-b42d-ae83364f05d5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:14.948493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:14.954919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.954919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.954919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.954919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:14.954919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:14.962189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1033/2042] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:14.966347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:14.977404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db0d1-b483-4309-b2fb-f754f970f535 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:14.982241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b96135-8918-41e4-a2b1-8b43a6ef11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:14.986367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96135-8918-41e4-a2b1-8b43a6ef11ba admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:14.986367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96135-8918-41e4-a2b1-8b43a6ef11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:14.986367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b96135-8918-41e4-a2b1-8b43a6ef11ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:14.986367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b96135-8918-41e4-a2b1-8b43a6ef11ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:14.986367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b96135-8918-41e4-a2b1-8b43a6ef11ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:14.997318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1010/2043] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:15.001480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:15.015192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c7300-f133-4600-affc-a55bf1fe68b6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:15.022207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:15.022884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:15.023166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:15.023430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] PATH_INFO: `/v3/projects/262cf586a8a64c68ba5e5be10fc8915b/users/4425a62bd8c64c1c85a5d8c7dde54bd7/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:15.041504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262cf586a8a64c68ba5e5be10fc8915b, user_id=4425a62bd8c64c1c85a5d8c7dde54bd7, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:15.044339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:15.140862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1034/2044] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:15 2022] PUT /identity/v3/projects/262cf586a8a64c68ba5e5be10fc8915b/users/4425a62bd8c64c1c85a5d8c7dde54bd7/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:15.146478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2c74f-e9de-4135-9aad-4c6ded441e9f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:15.146763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2c74f-e9de-4135-9aad-4c6ded441e9f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:15.147040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2c74f-e9de-4135-9aad-4c6ded441e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:15.167500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-48b2c74f-e9de-4135-9aad-4c6ded441e9f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:15.168730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-48b2c74f-e9de-4135-9aad-4c6ded441e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:15.223985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:15.237835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1011/2045] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:15.248471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:15.250936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:15.317631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ba0b7-d805-4456-a04c-476542192359 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:15.321575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:15.322185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:15.322482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:15.322750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:15.333011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:15.334455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:15.344692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1035/2046] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:07:16.742828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6af13-bdfc-459c-9e56-08fe97a01355 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:16.743356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6af13-bdfc-459c-9e56-08fe97a01355 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:16.743475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6af13-bdfc-459c-9e56-08fe97a01355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:16.778518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b1f6af13-bdfc-459c-9e56-08fe97a01355 None None] MFA Rules not processed for user `4425a62bd8c64c1c85a5d8c7dde54bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:16.780861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b1f6af13-bdfc-459c-9e56-08fe97a01355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:16.862464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1012/2047] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:16.873957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:16.875350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:16.933941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5adb1-88b8-4030-9a77-8df9f0729a4d service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:16.937620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:16.938407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:16.938964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:16.939478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:16.972173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:16.974605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:16.978514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:16.984960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1036/2048] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:18.780853 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f956a1-473f-461b-8154-a1381f43228d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:18.781342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f956a1-473f-461b-8154-a1381f43228d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:18.781430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f956a1-473f-461b-8154-a1381f43228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:18.801181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-24f956a1-473f-461b-8154-a1381f43228d None None] MFA Rules not processed for user `4425a62bd8c64c1c85a5d8c7dde54bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:18.802654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-24f956a1-473f-461b-8154-a1381f43228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:18.809710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1013/2049] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:22.268689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:22.270160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:22.284097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5997c70-5f3a-4b99-9f99-cad84f962266 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:22.289659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:22.290361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:22.290707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:22.291168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] PATH_INFO: `/v3/users/7217f01608f1426ca1792d993b256104` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:22.292293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7217f01608f1426ca1792d993b256104)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:22.294220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:22.533914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7217f01608f1426ca1792d993b256104'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:22.606025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7217f01608f1426ca1792d993b256104'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:22.607144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7217f01608f1426ca1792d993b256104'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:22.608113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7217f01608f1426ca1792d993b256104'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:22.621072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7217f01608f1426ca1792d993b256104'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:22.649649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1037/2050] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:22 2022] DELETE /identity/v3/users/7217f01608f1426ca1792d993b256104 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:22.651791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:22.652240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:22.652639 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:22.673592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:22.675096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:22.752121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1014/2051] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:22.765532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:22.767053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:22.836542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6491-eb03-4835-a777-d43a84535988 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:22.840148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d89dbd-2878-44de-b246-a8cfd516f6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:22.840796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d89dbd-2878-44de-b246-a8cfd516f6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:22.841139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d89dbd-2878-44de-b246-a8cfd516f6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:22.841423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d89dbd-2878-44de-b246-a8cfd516f6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:22.852661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d89dbd-2878-44de-b246-a8cfd516f6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:22.854094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d89dbd-2878-44de-b246-a8cfd516f6e1 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:22.866705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:22.868139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:22.873884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1038/2052] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:22.880748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610618-01e3-4577-aed7-c4d970b22b4f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:22.885636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:22.886324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:22.886607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:22.886905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] PATH_INFO: `/v3/users/b1d69f5b53604de8a12f062639fffa23` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:22.888449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d69f5b53604de8a12f062639fffa23)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:22.889968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:23.081901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d69f5b53604de8a12f062639fffa23'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.142170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d69f5b53604de8a12f062639fffa23'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.142851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d69f5b53604de8a12f062639fffa23'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.143498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d69f5b53604de8a12f062639fffa23'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.151330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d69f5b53604de8a12f062639fffa23'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.159558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:23.171049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1015/2053] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:22 2022] DELETE /identity/v3/users/b1d69f5b53604de8a12f062639fffa23 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:23.175667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.175997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.176918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.195570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:23.197476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:23.277939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1039/2054] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:23.287757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:23.289321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:23.351118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15f857-7f93-40e1-845e-19c0690776d5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:23.355020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f80a4-a465-4165-a22e-9d360ff41636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:23.355748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f80a4-a465-4165-a22e-9d360ff41636 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.356030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f80a4-a465-4165-a22e-9d360ff41636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.356324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f80a4-a465-4165-a22e-9d360ff41636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.368082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f80a4-a465-4165-a22e-9d360ff41636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:23.369835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f80a4-a465-4165-a22e-9d360ff41636 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:23.390914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1016/2055] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:23.464564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:23.466011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:23.490089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbde006-282a-4d28-b856-ab62b3e8a3b6 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:23.496964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:23.497675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.498026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.498375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] PATH_INFO: `/v3/projects/485d81b82dda4085be432e584af844c9` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.499566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] RBAC: Authorizing `identity:delete_project(project_id=485d81b82dda4085be432e584af844c9)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:23.501671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:23.511542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:23.635626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485d81b82dda4085be432e584af844c9', 'request_id': 'req-538ec430-2339-4f23-b810-7c6ef240254e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.641932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485d81b82dda4085be432e584af844c9', 'request_id': 'req-538ec430-2339-4f23-b810-7c6ef240254e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.716197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485d81b82dda4085be432e584af844c9', 'request_id': 'req-538ec430-2339-4f23-b810-7c6ef240254e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.729332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] The token cache is being invalidate because project 485d81b82dda4085be432e584af844c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:23.729677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.730345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-538ec430-2339-4f23-b810-7c6ef240254e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:23.736002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1040/2056] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:23 2022] DELETE /identity/v3/projects/485d81b82dda4085be432e584af844c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:23.737151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.737621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.737712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.758010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:23.760114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:23.842917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1017/2057] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:23.845003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.845294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.845628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.868903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:23.870130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:23.878831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1041/2058] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:23.883794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:23.896668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231e767-8b17-41dc-a999-76674a5b7db0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:23.898659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:23.899274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.899598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.900025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.900727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:07:23.901033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:23.902641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:23.915780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1018/2059] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:07:23.921296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:23.933238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91fd0c-248c-4d95-ae10-9bb33575a526 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:23.939639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:23.940372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:23.940731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:23.941079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:23.942004 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:23.944076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.030139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1042/2060] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:23 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:24.033443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.048358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5e973-a514-48dd-b54b-e99835ed4438 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.057311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.059590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:24.141236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.142334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.142831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.143293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.144117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.147386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.179618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7fdaa-5d59-4065-a308-9f63b9693767 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.185838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.186482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.186761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.187142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] PATH_INFO: `/v3/projects/f627ba12693f422db2f9b07e416f5b70` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.188173 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f627ba12693f422db2f9b07e416f5b70)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.190110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.253385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1019/2061] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:24 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:24.259589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.269478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb621df-d253-4e15-9225-1207343ab27a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.274374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.274976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.275257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.275530 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.276269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.277790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.283249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:24.292270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1020/2062] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:24.293233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.305320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676107-e234-4314-840f-24e3a81e32b5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.316332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f627ba12693f422db2f9b07e416f5b70', 'request_id': 'req-35a28038-3fb6-438a-b8e3-9721b30f5efd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:24.323552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f627ba12693f422db2f9b07e416f5b70', 'request_id': 'req-35a28038-3fb6-438a-b8e3-9721b30f5efd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:24.372852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.373476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.373761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.374039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.374690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.376329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.386601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1021/2063] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:24.390832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.400574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a00c47-fffa-444d-9dc0-943f7e6737a0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.405130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac83954-17f1-46e1-ac9d-c0fe41bba306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.405840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac83954-17f1-46e1-ac9d-c0fe41bba306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.406052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac83954-17f1-46e1-ac9d-c0fe41bba306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.406331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac83954-17f1-46e1-ac9d-c0fe41bba306 admin admin] PATH_INFO: `/v3/projects/faf30239517f43a8ae8469b6ec665ee9/users/f13f36ad8bf04921be4f090ec5788281/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.407407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f627ba12693f422db2f9b07e416f5b70', 'request_id': 'req-35a28038-3fb6-438a-b8e3-9721b30f5efd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:24.415540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:24.420244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] The token cache is being invalidate because project f627ba12693f422db2f9b07e416f5b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:24.420655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:24.421368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-35a28038-3fb6-438a-b8e3-9721b30f5efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:24.421901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac83954-17f1-46e1-ac9d-c0fe41bba306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf30239517f43a8ae8469b6ec665ee9, user_id=f13f36ad8bf04921be4f090ec5788281, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.423070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1043/2064] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:24 2022] DELETE /identity/v3/projects/f627ba12693f422db2f9b07e416f5b70 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:24.424717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac83954-17f1-46e1-ac9d-c0fe41bba306 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.427713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd99c10-835e-463d-9114-8cf9f079c815 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.427998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd99c10-835e-463d-9114-8cf9f079c815 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.428274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd99c10-835e-463d-9114-8cf9f079c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.448509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5dd99c10-835e-463d-9114-8cf9f079c815 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:24.449726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5dd99c10-835e-463d-9114-8cf9f079c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:24.458373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1044/2065] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:24.467570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.467854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.468129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.491560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:24.491560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:24.498171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1045/2066] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:24.502339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.526999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1022/2067] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:24 2022] PUT /identity/v3/projects/faf30239517f43a8ae8469b6ec665ee9/users/f13f36ad8bf04921be4f090ec5788281/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:24.527225 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdf0bb-ad6a-433d-ae9b-5a4668c4ad69 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.538659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.543103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.543103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.576173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] MFA Rules not processed for user `f13f36ad8bf04921be4f090ec5788281`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:24.577560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:24.603137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.604137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.604864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.604864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.605380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:07:24.605681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.607592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.623786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1046/2068] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:07:24.624820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.635514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f71da0-6adc-477f-bcb0-8fd20fc7491a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.641815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.642172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.642475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.642748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.643378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.645583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.663617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1023/2069] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:24.673014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.674515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:24.732507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93765-a930-4dcc-b9b9-d006edfd9bf4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.736110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.736761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.737037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.737312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.746481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.747921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.754339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1047/2070] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:24 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:07:24.759145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.762272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1024/2071] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:07:24.836554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476d6b-bb24-44e5-ab50-66c25e090198 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.842780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.843647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.843939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.844219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.845353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.847333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.939487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1048/2072] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:24 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:24.944044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.950728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:24.955445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfb69d-db2c-42ca-8746-14144807414b service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.960243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.961283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.961283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.961601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.962298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.963882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:24.973797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1025/2073] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:24.977971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:24.989869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b9fc7-e0ad-488b-ba11-7eacbe009862 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:24.995305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21b59-499f-4644-80a6-b7713de2dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:24.995951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21b59-499f-4644-80a6-b7713de2dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:24.996226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21b59-499f-4644-80a6-b7713de2dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:24.996525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21b59-499f-4644-80a6-b7713de2dc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:24.997527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d21b59-499f-4644-80a6-b7713de2dc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:24.999241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d21b59-499f-4644-80a6-b7713de2dc40 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.013935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1049/2074] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:25.018262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.031178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632c05-c6d7-4063-a671-e3fdad23df8b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.038784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.039466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.039751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.040032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] PATH_INFO: `/v3/projects/e419d25d75a04ecc84d781f415d702fa/users/157d6109327b4d2f962e8f2434d801fd/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.058225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e419d25d75a04ecc84d781f415d702fa, user_id=157d6109327b4d2f962e8f2434d801fd, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.060951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.144068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1026/2075] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:25 2022] PUT /identity/v3/projects/e419d25d75a04ecc84d781f415d702fa/users/157d6109327b4d2f962e8f2434d801fd/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:25.154658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.155011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.155321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.189707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] MFA Rules not processed for user `157d6109327b4d2f962e8f2434d801fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:25.190878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:25.224440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:25.281193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1050/2076] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:25.282641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.351267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849c42-34eb-4800-a976-07a6f24d63aa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.356320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.357437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.357713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.358060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.358767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.361131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.481010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1027/2077] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:25 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:07:25.485206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.496859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dc909-b729-4bc4-91e1-b13b8d60131b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.557304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.558118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.558397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.558694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.559339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.561283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.639456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1051/2078] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:25 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:25.643458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.654493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dc540-9c02-4e01-b89b-fab43474a03e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.659068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.659662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.659942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.660466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.661500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.663127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.678230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1028/2079] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:25.682307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.693161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533bc9-9934-4cd2-bffb-b31fe3df6333 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.697837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.698427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.698710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.698987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] PATH_INFO: `/v3/projects/ee98aa1910964c3dad7b5aa247f64ea4/users/69c63c6223174a36abfcc6ce48c8f15c/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.713916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee98aa1910964c3dad7b5aa247f64ea4, user_id=69c63c6223174a36abfcc6ce48c8f15c, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.716582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.795446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1052/2080] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:25 2022] PUT /identity/v3/projects/ee98aa1910964c3dad7b5aa247f64ea4/users/69c63c6223174a36abfcc6ce48c8f15c/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:25.799339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.810025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7cbbc-ad12-4717-8e55-c0c30245df08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.866845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e2ae-5347-4437-bbf5-6fbb4bd7b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.867509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e2ae-5347-4437-bbf5-6fbb4bd7b0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.867787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e2ae-5347-4437-bbf5-6fbb4bd7b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.868087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e2ae-5347-4437-bbf5-6fbb4bd7b0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.868757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e2ae-5347-4437-bbf5-6fbb4bd7b0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.870404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e2ae-5347-4437-bbf5-6fbb4bd7b0b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.880630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1029/2081] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:25.884958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:25.894938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a371-f29d-47f4-beea-b14daef4c507 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:25.899897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:25.900672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.900983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.901260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] PATH_INFO: `/v3/projects/ee98aa1910964c3dad7b5aa247f64ea4/users/69c63c6223174a36abfcc6ce48c8f15c/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.903209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee98aa1910964c3dad7b5aa247f64ea4, user_id=69c63c6223174a36abfcc6ce48c8f15c, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:25.905928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:25.916459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1053/2082] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:25 2022] PUT /identity/v3/projects/ee98aa1910964c3dad7b5aa247f64ea4/users/69c63c6223174a36abfcc6ce48c8f15c/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:25.927256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:25.927542 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:25.927816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:25.955256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] MFA Rules not processed for user `69c63c6223174a36abfcc6ce48c8f15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:25.956421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:25.986925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:26.029359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1030/2083] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:26.044446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:26.101802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86a2c7-2966-4197-9428-56413183ab9c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:26.105441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:26.106034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:26.106365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:26.106881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:26.116476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:26.118050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:26.127456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1054/2084] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:07:26.352004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:26.361922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2d2bf-3104-492a-a7a8-3881c56773fe None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:26.366411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ff4c-a11f-43f2-b242-12b0aa23ef55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:26.367013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ff4c-a11f-43f2-b242-12b0aa23ef55 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:26.367295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ff4c-a11f-43f2-b242-12b0aa23ef55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:26.367567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ff4c-a11f-43f2-b242-12b0aa23ef55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:26.426956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ff4c-a11f-43f2-b242-12b0aa23ef55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:26.428422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ff4c-a11f-43f2-b242-12b0aa23ef55 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:26.437692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1031/2085] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:27.838940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:27.840491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:27.876583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:27.931752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eecfc8-b1cd-4161-b468-1e71551d740a service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:27.937428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:27.938097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:27.938379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:27.938723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] PATH_INFO: `/v3/users/f13f36ad8bf04921be4f090ec5788281` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:27.939879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13f36ad8bf04921be4f090ec5788281)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:27.941925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:28.175243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13f36ad8bf04921be4f090ec5788281'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:28.251466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13f36ad8bf04921be4f090ec5788281'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:28.252248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13f36ad8bf04921be4f090ec5788281'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:28.252888 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13f36ad8bf04921be4f090ec5788281'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:28.260928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13f36ad8bf04921be4f090ec5788281'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:28.278909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1055/2086] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:27 2022] DELETE /identity/v3/users/f13f36ad8bf04921be4f090ec5788281 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:28.283764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:28.284238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:28.284338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:28.305271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:28.306484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:28.371202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1032/2087] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:28.380995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:28.382392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:28.438576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1fff0-8516-4ab7-8212-66778525665e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:28.442503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbcf01-a53e-430a-a6f6-7fa85d89d2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:28.443100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbcf01-a53e-430a-a6f6-7fa85d89d2cf service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:28.443375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbcf01-a53e-430a-a6f6-7fa85d89d2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:28.443643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbcf01-a53e-430a-a6f6-7fa85d89d2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:28.452861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbcf01-a53e-430a-a6f6-7fa85d89d2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:28.454300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbcf01-a53e-430a-a6f6-7fa85d89d2cf service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:28.464163 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1056/2088] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:28.938185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:28.940076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:28.956208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caed0e-ff48-466d-99d2-430c6fe67a9d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:28.961976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:28.962667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:28.962869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:28.963202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] PATH_INFO: `/v3/projects/faf30239517f43a8ae8469b6ec665ee9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:28.975281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf30239517f43a8ae8469b6ec665ee9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:28.975281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.083678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf30239517f43a8ae8469b6ec665ee9', 'request_id': 'req-16a2fd28-47fe-4985-931e-fc09a6604509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:29.090251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf30239517f43a8ae8469b6ec665ee9', 'request_id': 'req-16a2fd28-47fe-4985-931e-fc09a6604509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:29.095521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:29.205214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf30239517f43a8ae8469b6ec665ee9', 'request_id': 'req-16a2fd28-47fe-4985-931e-fc09a6604509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:29.216719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] The token cache is being invalidate because project faf30239517f43a8ae8469b6ec665ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:29.217009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:29.217803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16a2fd28-47fe-4985-931e-fc09a6604509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:29.219411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1033/2089] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:28 2022] DELETE /identity/v3/projects/faf30239517f43a8ae8469b6ec665ee9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:29.225058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.225537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.225628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.250258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:29.251455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:29.291490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:29.309984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1057/2090] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:29.319584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.320101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.320219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.339977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:29.341204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:29.349413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1034/2091] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:29.353684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:29.364154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17e11a-c197-4fa4-8246-16e4f011047b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:29.368723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:29.369323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.369604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.369881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.370526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:07:29.370828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:29.372420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.386942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1058/2092] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:07:29.391690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:29.405633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ba81e-c0c1-4c8a-8562-ae1472cc0063 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:29.410792 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:29.411046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.411327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.411607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.418355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:29.418355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.489156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1035/2093] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:29 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:29.493441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:29.503170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea3b72-0253-4bae-88da-1d2017c3af2a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:29.559943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:29.560499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.560778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.561050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.561667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:29.563551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.633525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1059/2094] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:29 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:29.634776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:29.645645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bff282-b7cb-4960-b23e-4cbd3a714caf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:29.650316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:29.650922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.651245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.651521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.652194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:29.653890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.664631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1036/2095] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:29.669023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:29.680256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2602c-144e-439f-81fc-fb94f97d0e4c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:29.685072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43febba-2297-47e9-af4e-91b199302200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:29.685871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43febba-2297-47e9-af4e-91b199302200 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.686151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43febba-2297-47e9-af4e-91b199302200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.686433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43febba-2297-47e9-af4e-91b199302200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.687075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43febba-2297-47e9-af4e-91b199302200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:29.688687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43febba-2297-47e9-af4e-91b199302200 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.704471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1060/2096] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:29.705652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:29.715664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6793f58-b94e-44c4-8183-59b5a1aad890 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:29.720288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:29.720973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.721547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.721935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] PATH_INFO: `/v3/projects/b79bf19911834bf79a3c00cbdde4043f/users/ab54d3d0de024586aa39e0863108c9f0/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.739668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79bf19911834bf79a3c00cbdde4043f, user_id=ab54d3d0de024586aa39e0863108c9f0, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:29.743296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:29.832679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1037/2097] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:29 2022] PUT /identity/v3/projects/b79bf19911834bf79a3c00cbdde4043f/users/ab54d3d0de024586aa39e0863108c9f0/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:29.839307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:29.839596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:29.839871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:29.887880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] MFA Rules not processed for user `ab54d3d0de024586aa39e0863108c9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:29.889109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:30.021219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1061/2098] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:30.042641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:30.044694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:30.118082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb9616-c838-4b23-ae63-56a96b6ad718 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:30.124115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d1b05-53e4-4a8e-8e59-42bec7a1855b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:30.124919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1b05-53e4-4a8e-8e59-42bec7a1855b service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:30.125259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1b05-53e4-4a8e-8e59-42bec7a1855b service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:30.125601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1b05-53e4-4a8e-8e59-42bec7a1855b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:30.139915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d1b05-53e4-4a8e-8e59-42bec7a1855b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:30.141816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d1b05-53e4-4a8e-8e59-42bec7a1855b service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:30.152880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1038/2099] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:35.849518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:35.851533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:35.894776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:35.917473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdca794-3763-4812-bd4f-2fa68ab9288a None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:35.922220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:35.922920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:35.923140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:35.923415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] PATH_INFO: `/v3/users/157d6109327b4d2f962e8f2434d801fd` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:35.924676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157d6109327b4d2f962e8f2434d801fd)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:35.926642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:36.097565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157d6109327b4d2f962e8f2434d801fd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.161281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157d6109327b4d2f962e8f2434d801fd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.161906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157d6109327b4d2f962e8f2434d801fd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.163255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157d6109327b4d2f962e8f2434d801fd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.170940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157d6109327b4d2f962e8f2434d801fd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.188914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1062/2100] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:35 2022] DELETE /identity/v3/users/157d6109327b4d2f962e8f2434d801fd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:36.193325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:36.193930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:36.194175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:36.216280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:36.218618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:36.282251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1039/2101] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:36.292628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:36.294062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:36.339506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:36.341012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:36.383523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ce62c-84b6-4404-b1cd-2daf18f18a48 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:36.384168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24175d16-76c8-49c4-9b58-5799093539b2 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:36.384344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:36.384344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:36.384344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:36.384344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] PATH_INFO: `/v3/users/ab54d3d0de024586aa39e0863108c9f0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:36.384875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419402b-bebd-41a2-90f6-ca03a22613b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:36.385080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab54d3d0de024586aa39e0863108c9f0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:36.385251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419402b-bebd-41a2-90f6-ca03a22613b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:36.385251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419402b-bebd-41a2-90f6-ca03a22613b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:36.385251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419402b-bebd-41a2-90f6-ca03a22613b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:36.385659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:36.385798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419402b-bebd-41a2-90f6-ca03a22613b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:36.385798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419402b-bebd-41a2-90f6-ca03a22613b1 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:36.395356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1063/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:36.401554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:36.690814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab54d3d0de024586aa39e0863108c9f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.765414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab54d3d0de024586aa39e0863108c9f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.766203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab54d3d0de024586aa39e0863108c9f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.766933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab54d3d0de024586aa39e0863108c9f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.774908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab54d3d0de024586aa39e0863108c9f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:36.798495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1040/2103] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:36 2022] DELETE /identity/v3/users/ab54d3d0de024586aa39e0863108c9f0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:36.804072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:36.804420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:36.804704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:36.824567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:36.825802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:36.854312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:36.855821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:36.890651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:36.901294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1064/2104] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:07:36.911022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:36.912514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:36.941820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c01fc-fdee-4a87-ae60-3242fa26a027 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:36.946757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:36.947485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:36.947835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:36.948179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] PATH_INFO: `/v3/projects/e419d25d75a04ecc84d781f415d702fa` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:36.949439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e419d25d75a04ecc84d781f415d702fa)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:36.951399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:36.979639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d0047-be5f-4a2e-933a-6fcb6e135f4f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:36.987487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:36.988230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:36.988563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:36.988816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:36.999137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:37.000610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:37.010185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1065/2105] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:07:37.091480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e419d25d75a04ecc84d781f415d702fa', 'request_id': 'req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.098288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e419d25d75a04ecc84d781f415d702fa', 'request_id': 'req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.171116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e419d25d75a04ecc84d781f415d702fa', 'request_id': 'req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.183289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] The token cache is being invalidate because project e419d25d75a04ecc84d781f415d702fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:37.183576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.184218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.185845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1041/2106] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:36 2022] DELETE /identity/v3/projects/e419d25d75a04ecc84d781f415d702fa => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:37.189855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:37.200276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8547c55-2aef-47fd-9d06-0b33740167d6 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:37.274910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:37.275601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:37.275884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:37.276154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] PATH_INFO: `/v3/users/69c63c6223174a36abfcc6ce48c8f15c` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:37.277380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c63c6223174a36abfcc6ce48c8f15c)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:37.279373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:37.474273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c63c6223174a36abfcc6ce48c8f15c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.494974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:37.496567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:37.510571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b535eae-3adb-4ba4-9b82-a2e311fbbe59 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:37.515234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:37.515925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:37.516169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:37.516513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] PATH_INFO: `/v3/projects/b79bf19911834bf79a3c00cbdde4043f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:37.522978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79bf19911834bf79a3c00cbdde4043f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:37.522978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:37.548100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:37.587422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c63c6223174a36abfcc6ce48c8f15c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.588229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c63c6223174a36abfcc6ce48c8f15c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.588884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c63c6223174a36abfcc6ce48c8f15c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.604009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c63c6223174a36abfcc6ce48c8f15c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.622358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1066/2107] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:37 2022] DELETE /identity/v3/users/69c63c6223174a36abfcc6ce48c8f15c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:37.639171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79bf19911834bf79a3c00cbdde4043f', 'request_id': 'req-922e7c44-3546-4e97-8b4b-621ac475d238'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.645830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79bf19911834bf79a3c00cbdde4043f', 'request_id': 'req-922e7c44-3546-4e97-8b4b-621ac475d238'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.722536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79bf19911834bf79a3c00cbdde4043f', 'request_id': 'req-922e7c44-3546-4e97-8b4b-621ac475d238'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.738442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] The token cache is being invalidate because project b79bf19911834bf79a3c00cbdde4043f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:37.738737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.739397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-922e7c44-3546-4e97-8b4b-621ac475d238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:37.741575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1042/2108] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:37 2022] DELETE /identity/v3/projects/b79bf19911834bf79a3c00cbdde4043f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:07:38.057611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:38.059218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:38.092070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:38.129818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e42a6-d575-4ca2-b4c3-26fbc6f1c93a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:38.189768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:38.190400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.190679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.190955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] PATH_INFO: `/v3/projects/ee98aa1910964c3dad7b5aa247f64ea4` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.192251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee98aa1910964c3dad7b5aa247f64ea4)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:38.194571 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:38.296884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee98aa1910964c3dad7b5aa247f64ea4', 'request_id': 'req-edbbec72-516e-4a58-a00e-fa86a51d46dc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:38.303085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee98aa1910964c3dad7b5aa247f64ea4', 'request_id': 'req-edbbec72-516e-4a58-a00e-fa86a51d46dc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:38.404564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee98aa1910964c3dad7b5aa247f64ea4', 'request_id': 'req-edbbec72-516e-4a58-a00e-fa86a51d46dc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:38.416293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] The token cache is being invalidate because project ee98aa1910964c3dad7b5aa247f64ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:07:38.416651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:38.417273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-edbbec72-516e-4a58-a00e-fa86a51d46dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:38.418769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1067/2109] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:07:38 2022] DELETE /identity/v3/projects/ee98aa1910964c3dad7b5aa247f64ea4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:38.423786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.424080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.424414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.447714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:38.448964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:38.510953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1043/2110] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:38.518831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.519179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.519462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.540575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:38.541840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:38.549978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1068/2111] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:38.554803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:38.564587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ba482-3d9b-4f53-85f8-37e442a8c052 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:38.569726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:38.570310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.570586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.570856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.571498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:07:38.571797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:38.573395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:38.584806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1044/2112] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:07:38.589058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:38.598354 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e61b9-a154-43fe-b554-b8b45d293189 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:38.603736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:38.604373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.604660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.604938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.605604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:38.607757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:38.744417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1069/2113] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:38 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:07:38.748662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:38.759464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87afab-606c-4dba-9ac1-3e19415e35f6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:38.836871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:38.837451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.838198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.838198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.838793 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:38.840807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:38.936987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1045/2114] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:38 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:38.941236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:38.952202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496c0ce-e643-48dd-9b2a-06d29e1979e0 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:38.956801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:38.957393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.957674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.957951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.958586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:38.960210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:38.969886 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1070/2115] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:07:38.973707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:38.984081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddc9f9-2b1a-414c-9692-d73ddae8fc3d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:38.988601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf326d-273a-405b-91f4-add49012803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:38.989181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf326d-273a-405b-91f4-add49012803e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:38.989458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf326d-273a-405b-91f4-add49012803e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:38.989729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf326d-273a-405b-91f4-add49012803e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:38.990982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf326d-273a-405b-91f4-add49012803e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:38.992574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf326d-273a-405b-91f4-add49012803e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.003328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1046/2116] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:39.009094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.019787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20d8a0-c91d-4bcb-bd08-4142c39e5ba4 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.025149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.025819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.026101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.026383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] PATH_INFO: `/v3/projects/63a32012bc6f4a7784b974690474e4bb/users/60df9f9658414f8b9e98e8eafe184663/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.043055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a32012bc6f4a7784b974690474e4bb, user_id=60df9f9658414f8b9e98e8eafe184663, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.045911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.048968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:39.138763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1071/2117] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:39 2022] PUT /identity/v3/projects/63a32012bc6f4a7784b974690474e4bb/users/60df9f9658414f8b9e98e8eafe184663/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:39.149820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.154185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.154185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.190024 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] MFA Rules not processed for user `60df9f9658414f8b9e98e8eafe184663`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:39.191231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:39.196705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:39.258041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1047/2118] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:39.262465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.333734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc25e1-2aed-4c72-8626-32a66bce7f73 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.339086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.339725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.339997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.340267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.340936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.342802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.407903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1072/2119] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:07:39 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:39.411966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.423306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61decd-3914-44d6-9cc9-255214ed3ecb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.478994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.479593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.479868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.480155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.480782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.482948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.582634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1048/2120] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:07:39 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:07:39.587259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.597730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00f289-2524-48b8-bb10-7059f3430b97 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.602678 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.603280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.603561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.603834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.604518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.606088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.617092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1073/2121] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:39.621191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.631667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34162c-fc3b-453e-8024-55d13920d6b9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.636658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.637437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.637724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.638008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] PATH_INFO: `/v3/projects/40b7f0d7cd364aebb4fdae05d51bec7a/users/4058199df047498baa807e1dafa2a76c/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.657054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b7f0d7cd364aebb4fdae05d51bec7a, user_id=4058199df047498baa807e1dafa2a76c, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.659821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.760609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1049/2122] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:39 2022] PUT /identity/v3/projects/40b7f0d7cd364aebb4fdae05d51bec7a/users/4058199df047498baa807e1dafa2a76c/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:39.764821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.778925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c76b6-008b-4e5b-9eb0-e85034354afc admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.835371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552cb10-d248-4328-b987-744e3a74147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.835965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cb10-d248-4328-b987-744e3a74147a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.836264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cb10-d248-4328-b987-744e3a74147a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.836564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552cb10-d248-4328-b987-744e3a74147a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.837190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552cb10-d248-4328-b987-744e3a74147a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.838748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552cb10-d248-4328-b987-744e3a74147a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.851126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1074/2123] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:07:39.852292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:39.862790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e54f-2e2b-4e73-b549-b1ed293f9bd5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:39.867931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:39.868670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.868948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.869202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] PATH_INFO: `/v3/projects/40b7f0d7cd364aebb4fdae05d51bec7a/users/4058199df047498baa807e1dafa2a76c/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.871072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b7f0d7cd364aebb4fdae05d51bec7a, user_id=4058199df047498baa807e1dafa2a76c, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:39.873791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:39.885394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1050/2124] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:07:39 2022] PUT /identity/v3/projects/40b7f0d7cd364aebb4fdae05d51bec7a/users/4058199df047498baa807e1dafa2a76c/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:39.896679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:39.896994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:39.897246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:39.925688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] MFA Rules not processed for user `4058199df047498baa807e1dafa2a76c`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:39.926937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:39.979634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:40.001598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1075/2125] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:40.009432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:40.011146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:40.078140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822ea80-177e-46b5-9e39-3cdb5cfc5b18 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:40.083954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0621d8-dfa7-4ce1-8684-d3b6dc901cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:40.083954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0621d8-dfa7-4ce1-8684-d3b6dc901cad service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:40.083954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0621d8-dfa7-4ce1-8684-d3b6dc901cad service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:40.083954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0621d8-dfa7-4ce1-8684-d3b6dc901cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:40.096061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:40.142032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0621d8-dfa7-4ce1-8684-d3b6dc901cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:40.143770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0621d8-dfa7-4ce1-8684-d3b6dc901cad service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:40.153660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1051/2126] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:07:43.403330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:43.413369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44461f23-2c06-40e3-9295-dd0547701239 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:43.417402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:43.418051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:43.418346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:43.418602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:43.428108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:43.429718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:43.442099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1076/2127] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:50.261925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=21 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:53.437404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=10 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:07:57.409813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:57.410356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:57.410356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:57.430442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:57.431641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:57.493541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1052/2128] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:57.508922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:57.510378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:57.594370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615304-d040-442f-bbca-20aab7bf51d3 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:57.608807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac988b-31cd-4ee0-853e-6158a3e44a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:57.609440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac988b-31cd-4ee0-853e-6158a3e44a0c service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:57.609717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac988b-31cd-4ee0-853e-6158a3e44a0c service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:57.610054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac988b-31cd-4ee0-853e-6158a3e44a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:57.620032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac988b-31cd-4ee0-853e-6158a3e44a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:57.622147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac988b-31cd-4ee0-853e-6158a3e44a0c service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:57.632591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1077/2129] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:07:59.072078 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:59.088027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902e0f-b2a0-44b6-8bb1-cf6c4a4de44b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:59.095012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:59.096128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:59.096713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:59.097144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] PATH_INFO: `/v3/users/60df9f9658414f8b9e98e8eafe184663` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:59.098821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60df9f9658414f8b9e98e8eafe184663)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:59.101207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:59.304702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60df9f9658414f8b9e98e8eafe184663'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:59.371545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60df9f9658414f8b9e98e8eafe184663'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:59.372146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60df9f9658414f8b9e98e8eafe184663'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:59.372812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60df9f9658414f8b9e98e8eafe184663'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:59.381272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60df9f9658414f8b9e98e8eafe184663'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:07:59.400562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1053/2130] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:07:59 2022] DELETE /identity/v3/users/60df9f9658414f8b9e98e8eafe184663 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:07:59.406500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:59.406500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:59.407345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:59.427645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:07:59.428909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:59.493543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1078/2131] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:07:59.505347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:07:59.506841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:07:59.573867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0c4f1-8e3e-4c52-95ae-e23e915b4548 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:07:59.578594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:07:59.579263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:07:59.579765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:07:59.579890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:07:59.590240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:07:59.592211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:07:59.602517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1054/2132] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:00.067288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:00.068700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:00.086501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895c57e-4ae0-4cb2-b327-b339782f4c57 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:00.092906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:00.093688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:00.093913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:00.100236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] PATH_INFO: `/v3/projects/63a32012bc6f4a7784b974690474e4bb` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:00.100236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a32012bc6f4a7784b974690474e4bb)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:00.100236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:00.267729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a32012bc6f4a7784b974690474e4bb', 'request_id': 'req-b250caca-dc0a-437d-9172-64f6318bd759'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.284464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a32012bc6f4a7784b974690474e4bb', 'request_id': 'req-b250caca-dc0a-437d-9172-64f6318bd759'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.350976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a32012bc6f4a7784b974690474e4bb', 'request_id': 'req-b250caca-dc0a-437d-9172-64f6318bd759'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.363579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] The token cache is being invalidate because project 63a32012bc6f4a7784b974690474e4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:00.364367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.364987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.366530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1079/2133] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:00 2022] DELETE /identity/v3/projects/63a32012bc6f4a7784b974690474e4bb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:00.374976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:00.385127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29781-c995-407d-b69c-d9433f30b589 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:00.397519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:00.455942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:00.456624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:00.456926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:00.457203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] PATH_INFO: `/v3/users/4058199df047498baa807e1dafa2a76c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:00.458351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4058199df047498baa807e1dafa2a76c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:00.460433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:00.727911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4058199df047498baa807e1dafa2a76c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.806015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4058199df047498baa807e1dafa2a76c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.806642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4058199df047498baa807e1dafa2a76c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.807965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4058199df047498baa807e1dafa2a76c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.825780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bc4c5a38-518e-4a56-b759-26c9a4e745d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4058199df047498baa807e1dafa2a76c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:00.858534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1055/2134] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:00 2022] DELETE /identity/v3/users/4058199df047498baa807e1dafa2a76c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:01.252301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:01.253840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:01.271077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250caca-dc0a-437d-9172-64f6318bd759 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:01.276683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:01.330651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:01.331279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:01.331617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:01.331892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] PATH_INFO: `/v3/projects/40b7f0d7cd364aebb4fdae05d51bec7a` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:01.333017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b7f0d7cd364aebb4fdae05d51bec7a)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:01.334920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:01.491352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b7f0d7cd364aebb4fdae05d51bec7a', 'request_id': 'req-f6a138c9-654b-4bd3-9892-0a900630d54d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:01.498718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b7f0d7cd364aebb4fdae05d51bec7a', 'request_id': 'req-f6a138c9-654b-4bd3-9892-0a900630d54d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:01.580774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b7f0d7cd364aebb4fdae05d51bec7a', 'request_id': 'req-f6a138c9-654b-4bd3-9892-0a900630d54d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:01.593624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] The token cache is being invalidate because project 40b7f0d7cd364aebb4fdae05d51bec7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:01.593918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:01.594600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f6a138c9-654b-4bd3-9892-0a900630d54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:01.596107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1080/2135] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:01 2022] DELETE /identity/v3/projects/40b7f0d7cd364aebb4fdae05d51bec7a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:01.601039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:01.601512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:01.601617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:01.624213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:01.626510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:01.694898 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1056/2136] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:01.702581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:01.702872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:01.703256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:01.728144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:01.729414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:01.738731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1081/2137] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:01.743151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:01.754341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e498efa-4297-4812-8c8c-3cbaffc4ecd8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:01.759921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:01.760653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:01.762460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:01.762460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:01.762460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:08:01.762460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:01.764192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:01.780700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1057/2138] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:08:01.782418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:01.794862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2282ba7-2232-4562-87ac-7e220ee4c655 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:01.799639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:01.805083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:01.805083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:01.805083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:01.805083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:01.805083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:01.905328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1082/2139] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:01 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:08:01.909675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:01.930377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c808c-5305-435c-adad-b048bb59ca56 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:01.967815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:02.021007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.023112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.023498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.023984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.024928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.031958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.124288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1058/2140] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:01 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:02.128433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.138744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d3a5f-709c-4d02-bb59-946a64623105 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.143266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.143867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.144149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.144465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.145112 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.146677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.157404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1083/2141] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:02.161392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.172376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96b72e-a690-4517-82a4-077008014e1e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.177512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747b752-3afc-488d-a45f-4425a4f8467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.178142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b752-3afc-488d-a45f-4425a4f8467f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.178425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b752-3afc-488d-a45f-4425a4f8467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.178870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747b752-3afc-488d-a45f-4425a4f8467f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.180337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747b752-3afc-488d-a45f-4425a4f8467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.182154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747b752-3afc-488d-a45f-4425a4f8467f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.192297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1059/2142] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:02.196510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.207832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423d59-8a30-4560-92aa-00928694890e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.212595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.213540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.213540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.213781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] PATH_INFO: `/v3/projects/c934f6000d834bd6b9f5617e1df8d35b/users/7c291c8bd6744a0ea0ac49e7b2338b0c/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.229753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c934f6000d834bd6b9f5617e1df8d35b, user_id=7c291c8bd6744a0ea0ac49e7b2338b0c, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.233896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.342444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1084/2143] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:02 2022] PUT /identity/v3/projects/c934f6000d834bd6b9f5617e1df8d35b/users/7c291c8bd6744a0ea0ac49e7b2338b0c/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:02.352822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.353164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.353645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.390909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] MFA Rules not processed for user `7c291c8bd6744a0ea0ac49e7b2338b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:02.392394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:02.462781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1060/2144] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:02.467957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.521504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:02.546192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0465c-e7be-4c33-b789-97e5861c0527 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.551075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.551697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.552003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.552277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.552961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.554876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.639925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1085/2145] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:02 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:08:02.641175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.654443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d6dd-14b9-4c8e-84d1-b2bb570dfd1a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.726617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.727386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.727731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.728073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.728835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.731183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.792632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1061/2146] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:02 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:02.803638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.814493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ce41-82cd-4848-a0f7-bdc5460ffe3f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.819143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.819741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.820023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.820296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.823835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.823835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.832917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1086/2147] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:02.837156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:02.847548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f543-309f-48e6-a87d-76a166fe2750 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:02.852069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:02.852738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:02.853017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:02.853324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] PATH_INFO: `/v3/projects/ab4d981872094432a39f914a407ec9cc/users/56dd7b2978ef454f897e44aa427d257c/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:02.869515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4d981872094432a39f914a407ec9cc, user_id=56dd7b2978ef454f897e44aa427d257c, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:02.872411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:02.875711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:02.991497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1062/2148] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:02 2022] PUT /identity/v3/projects/ab4d981872094432a39f914a407ec9cc/users/56dd7b2978ef454f897e44aa427d257c/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:02.997021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:03.007471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255f84-45ec-4153-8087-6b7334360ae3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:03.067547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202d8b9-af77-4261-984a-fa5e6ec84979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:03.068167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d8b9-af77-4261-984a-fa5e6ec84979 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:03.068579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d8b9-af77-4261-984a-fa5e6ec84979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:03.068732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d8b9-af77-4261-984a-fa5e6ec84979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:03.069376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202d8b9-af77-4261-984a-fa5e6ec84979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:03.071139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202d8b9-af77-4261-984a-fa5e6ec84979 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:03.083363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1087/2149] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:08:03.087384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:03.098520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dadc9-2032-433f-8062-22c7edd58d08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:03.106501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:03.107247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:03.108173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:03.108391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] PATH_INFO: `/v3/projects/ab4d981872094432a39f914a407ec9cc/users/56dd7b2978ef454f897e44aa427d257c/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:03.110492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4d981872094432a39f914a407ec9cc, user_id=56dd7b2978ef454f897e44aa427d257c, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:03.113323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:03.125284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1063/2150] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:03 2022] PUT /identity/v3/projects/ab4d981872094432a39f914a407ec9cc/users/56dd7b2978ef454f897e44aa427d257c/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:08:03.139279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195f1af-7395-42af-931a-5309b1caf0f2 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:03.139570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195f1af-7395-42af-931a-5309b1caf0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:03.139847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195f1af-7395-42af-931a-5309b1caf0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:03.170339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c195f1af-7395-42af-931a-5309b1caf0f2 None None] MFA Rules not processed for user `56dd7b2978ef454f897e44aa427d257c`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:03.171712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c195f1af-7395-42af-931a-5309b1caf0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:03.263952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1088/2151] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:03.281038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:03.282755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:03.360941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4a98-1cf3-4d4c-8f4b-0f25fdf3260d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:03.364779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:03.365384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:03.365668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:03.365946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:03.375719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:03.377173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:03.389092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1064/2152] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:03.753615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:03.754192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:03.754561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:03.775175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:03.776679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:03.808438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:03.860988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1089/2153] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:03.879025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:03.880585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:03.991346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4aa6a-9ad1-41db-acb4-c361d894bd60 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:03.997322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:03.998589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:03.998589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:03.998589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:04.007931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:04.009606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:04.020734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1065/2154] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:04.326393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:04.338861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aaef4-a06e-4aac-bd0a-16d806f737b9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:04.344198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dd7b2978ef454f897e44aa427d257c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab4d981872094432a39f914a407ec9cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:04.344840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:04.345258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:04.345546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:04.346203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:08:04.346507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:04.348089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:04.362698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1090/2155] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:08:04.366889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:04.379580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25642017-29f8-4e8e-bb15-6624e4110b84 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:04.385637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab048a05-b90f-42b3-b45c-0142f398f782 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dd7b2978ef454f897e44aa427d257c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab4d981872094432a39f914a407ec9cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:04.386254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048a05-b90f-42b3-b45c-0142f398f782 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:04.386538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048a05-b90f-42b3-b45c-0142f398f782 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:04.386820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048a05-b90f-42b3-b45c-0142f398f782 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:04.387507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab048a05-b90f-42b3-b45c-0142f398f782 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:04.389453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab048a05-b90f-42b3-b45c-0142f398f782 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:04.517411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1066/2156] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:04 2022] POST /identity/v3/projects => generated 354 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:08:04.520813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:04.530841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4802e9-f21c-44d4-b2f6-ee0abd8d97a3 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:04.559732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:04.560118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:04.560329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:04.597628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dd7b2978ef454f897e44aa427d257c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab4d981872094432a39f914a407ec9cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:04.598257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:04.598544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:04.599294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:04.599980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:08:04.600274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:04.609933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:04.610053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] MFA Rules not processed for user `5111139cdb444281b95871311f9c7f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:04.610053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:04.618682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1091/2157] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:08:04.660971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:04.667989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:04.672010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddfa2-8bb0-4341-8770-cad1bf7a6916 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:04.676784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dd7b2978ef454f897e44aa427d257c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab4d981872094432a39f914a407ec9cc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:04.677404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:04.684716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:04.684716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] PATH_INFO: `/v3/projects/9a8ede0586cc4209a78fec6052b23280` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:04.684716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a8ede0586cc4209a78fec6052b23280)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:04.684986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1067/2158] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:04.685072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:04.817413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8ede0586cc4209a78fec6052b23280', 'request_id': 'req-ed3a15a5-6428-470a-b1e8-42b7438bfe78'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:04.830507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8ede0586cc4209a78fec6052b23280', 'request_id': 'req-ed3a15a5-6428-470a-b1e8-42b7438bfe78'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:04.906466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8ede0586cc4209a78fec6052b23280', 'request_id': 'req-ed3a15a5-6428-470a-b1e8-42b7438bfe78'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:04.919296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] The token cache is being invalidate because project 9a8ede0586cc4209a78fec6052b23280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:04.919591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:04.920268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ed3a15a5-6428-470a-b1e8-42b7438bfe78 tempest-VolumeQuotaClassesTest-266422134 tempest-VolumeQuotaClassesTest-266422134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:04.922111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1092/2159] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:04 2022] DELETE /identity/v3/projects/9a8ede0586cc4209a78fec6052b23280 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:08:05.675131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:05.761897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7d590-a7ea-40a0-b2b3-86919326e6a4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:05.824319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:05.825020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:05.825344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:05.825626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] PATH_INFO: `/v3/users/7c291c8bd6744a0ea0ac49e7b2338b0c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:05.826782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c291c8bd6744a0ea0ac49e7b2338b0c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:05.828791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:06.017459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c291c8bd6744a0ea0ac49e7b2338b0c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:06.102908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c291c8bd6744a0ea0ac49e7b2338b0c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:06.103625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c291c8bd6744a0ea0ac49e7b2338b0c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:06.104413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c291c8bd6744a0ea0ac49e7b2338b0c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:06.117600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c291c8bd6744a0ea0ac49e7b2338b0c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:06.146711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1068/2160] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:05 2022] DELETE /identity/v3/users/7c291c8bd6744a0ea0ac49e7b2338b0c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:06.149448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:06.150150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:06.150150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:06.171775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:06.173463 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:06.224846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:06.256347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1093/2161] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:06.267924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:06.268410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:06.299386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:06.344634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cdde0-f19b-4454-92da-7e7f812fc50a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:06.348460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:06.353909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:06.353909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:06.353909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:06.359506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:06.361124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:06.370998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1069/2162] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:06.861328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:06.862764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:06.874798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18083fee-1091-4593-83ce-e6f6b6d05ea9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:06.879522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:06.880150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:06.880468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:06.880743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] PATH_INFO: `/v3/projects/c934f6000d834bd6b9f5617e1df8d35b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:06.882089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c934f6000d834bd6b9f5617e1df8d35b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:06.884395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:07.012811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c934f6000d834bd6b9f5617e1df8d35b', 'request_id': 'req-c4624f1e-0d39-40c4-b01c-3b110c99cc59'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.019407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c934f6000d834bd6b9f5617e1df8d35b', 'request_id': 'req-c4624f1e-0d39-40c4-b01c-3b110c99cc59'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.079522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c934f6000d834bd6b9f5617e1df8d35b', 'request_id': 'req-c4624f1e-0d39-40c4-b01c-3b110c99cc59'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.100474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] The token cache is being invalidate because project c934f6000d834bd6b9f5617e1df8d35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:07.101001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.101821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.108763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1094/2163] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:06 2022] DELETE /identity/v3/projects/c934f6000d834bd6b9f5617e1df8d35b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:07.111219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:07.128026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e1612-c1ac-4fe8-8ed0-205120f6608b service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:07.187137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:07.187785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:07.188054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:07.188345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] PATH_INFO: `/v3/users/56dd7b2978ef454f897e44aa427d257c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:07.189479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dd7b2978ef454f897e44aa427d257c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:07.191546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:07.575583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dd7b2978ef454f897e44aa427d257c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.673884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dd7b2978ef454f897e44aa427d257c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.674545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dd7b2978ef454f897e44aa427d257c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.675138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dd7b2978ef454f897e44aa427d257c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.682979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-df37452a-9476-4e1b-a86b-1bd97d36e4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dd7b2978ef454f897e44aa427d257c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:07.705225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1070/2164] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:07 2022] DELETE /identity/v3/users/56dd7b2978ef454f897e44aa427d257c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:08.360952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:08.362475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:08.376654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4624f1e-0d39-40c4-b01c-3b110c99cc59 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:08.447048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:08.447699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:08.447997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:08.448189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] PATH_INFO: `/v3/projects/ab4d981872094432a39f914a407ec9cc` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:08.453503 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4d981872094432a39f914a407ec9cc)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:08.455692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:08.632302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4d981872094432a39f914a407ec9cc', 'request_id': 'req-f744dbd6-0500-4e82-869a-fbb8780f27b6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:08.639797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4d981872094432a39f914a407ec9cc', 'request_id': 'req-f744dbd6-0500-4e82-869a-fbb8780f27b6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:08.697181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4d981872094432a39f914a407ec9cc', 'request_id': 'req-f744dbd6-0500-4e82-869a-fbb8780f27b6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:08.699003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:08.713295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] The token cache is being invalidate because project ab4d981872094432a39f914a407ec9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:08.713597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:08.715559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f744dbd6-0500-4e82-869a-fbb8780f27b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:08.718597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1095/2165] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:08 2022] DELETE /identity/v3/projects/ab4d981872094432a39f914a407ec9cc => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:08:08.723554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:08.724497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:08.724497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:08.750181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:08.751801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:08.817685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:08.842505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1071/2166] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:08.850578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:08.850860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:08.851138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:08.872395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:08.873935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:08.883265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1096/2167] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:08.887703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:08.914712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e226d8-48d8-4852-acea-d61de386d5c1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:08.933158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:08.936287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:08.936287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:08.936287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:08.937658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:08:08.937991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:08.939974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:08.954593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1072/2168] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:08:08.958919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:08.968199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c5dbf-13dc-4140-a347-dea5636daee7 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:08.973901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:08.974726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:08.974848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:08.975205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:08.975879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:08.977697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.074973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1097/2169] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:08 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:09.079807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.090014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4abda-980f-47d9-8715-ca3ca2f8e687 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.152188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1601375-70f4-49dc-8430-1c3b9e01a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:09.152803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601375-70f4-49dc-8430-1c3b9e01a28a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.153094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601375-70f4-49dc-8430-1c3b9e01a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.154899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1601375-70f4-49dc-8430-1c3b9e01a28a admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.155278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601375-70f4-49dc-8430-1c3b9e01a28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:09.157347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1601375-70f4-49dc-8430-1c3b9e01a28a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.295449 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1073/2170] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:09 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:09.299716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.310705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213c16c-9c66-4f24-96df-b6a3e494b6bb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.317719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:09.318356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.319275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.319275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.319549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:09.321219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.325706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.326522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.326957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.335817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1098/2171] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:08:09.337763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.349533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248f2b-dae4-499d-8e30-0afbcfd8c181 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.351732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:09.353349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:09.353552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:09.354164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.354567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.354853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.355569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:09.357438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.363323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1074/2172] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:09.371027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1099/2173] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:09.375970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.377852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.380166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:09.384453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b43d8-f1ba-44a6-bde2-9502f7fb36f7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.390178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730d7b-62e3-4048-ac40-955bf1604c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:09.391478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730d7b-62e3-4048-ac40-955bf1604c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.391860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730d7b-62e3-4048-ac40-955bf1604c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.392239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730d7b-62e3-4048-ac40-955bf1604c7a admin admin] PATH_INFO: `/v3/projects/6facad817b8548ffadfd03cd2a6035a1/users/174c59b2f9d84be781e75980e49842bd/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.414217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730d7b-62e3-4048-ac40-955bf1604c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6facad817b8548ffadfd03cd2a6035a1, user_id=174c59b2f9d84be781e75980e49842bd, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:09.417172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730d7b-62e3-4048-ac40-955bf1604c7a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.470889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aacad-9f26-41ad-8d38-b669be999a2d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.476506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5eadb-acf8-414f-b639-0d78e91417c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:09.477253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5eadb-acf8-414f-b639-0d78e91417c0 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.477661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5eadb-acf8-414f-b639-0d78e91417c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.477846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5eadb-acf8-414f-b639-0d78e91417c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.486895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5eadb-acf8-414f-b639-0d78e91417c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:09.488694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5eadb-acf8-414f-b639-0d78e91417c0 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.497922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1100/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:09.574095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.574387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.574668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.577042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1075/2175] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:09 2022] PUT /identity/v3/projects/6facad817b8548ffadfd03cd2a6035a1/users/174c59b2f9d84be781e75980e49842bd/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:09.588107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.588685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.589214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.597796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] MFA Rules not processed for user `d8d1da88813d49cf9abb7b626a94259e`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:09.599094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:09.643614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] MFA Rules not processed for user `174c59b2f9d84be781e75980e49842bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:09.644228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:09.677484 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1101/2176] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:09.741919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1076/2177] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:09.746787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.786869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:09.824286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38f92-6a6a-4a00-be35-2e1067d883d4 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.831224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:09.836602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:09.836602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:09.836602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:09.836602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:09.836602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:09.920793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1102/2178] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:09 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:09.925275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:09.940125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f009de-ae94-416b-87da-9a4a56e7d473 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:09.961311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:10.031322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.032008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.032293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.036382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.036382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.036382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.116571 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1077/2179] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:09 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:08:10.120843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.132102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e1150-8207-463d-b18a-5ffd81509395 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.136783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.137378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.138331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.138610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.139333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.140936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.151089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1103/2180] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:10.155919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.171773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f68018-a98b-4633-b510-f0db93e634f4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.176767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd76bce-11c9-45c6-b131-b9d8f0f5f2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.177371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd76bce-11c9-45c6-b131-b9d8f0f5f2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.177798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd76bce-11c9-45c6-b131-b9d8f0f5f2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.177919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd76bce-11c9-45c6-b131-b9d8f0f5f2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.178556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd76bce-11c9-45c6-b131-b9d8f0f5f2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.181174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd76bce-11c9-45c6-b131-b9d8f0f5f2d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.204196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1078/2181] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:10.208688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.220779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60f295-3cdb-4898-b414-109b74d6f0b3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.226570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.237017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.237017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.237017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] PATH_INFO: `/v3/projects/2c32cb6481c941daa35f20d1cc4b20de/users/0509acf2e1224b8184fdc098d2ce355f/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.243594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c32cb6481c941daa35f20d1cc4b20de, user_id=0509acf2e1224b8184fdc098d2ce355f, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.246351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.346781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1104/2182] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:10 2022] PUT /identity/v3/projects/2c32cb6481c941daa35f20d1cc4b20de/users/0509acf2e1224b8184fdc098d2ce355f/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:08:10.358296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.363421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.363421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.388458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] MFA Rules not processed for user `0509acf2e1224b8184fdc098d2ce355f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:10.389689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:10.464810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1079/2183] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:10.469659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.561244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d703d62-770c-4dab-a3a4-dec85f7d561e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.566307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.567017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.568959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.568959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.568959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.570818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.685443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1105/2184] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:10 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:08:10.689394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.702804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bfa7f-51c5-46d3-8bb6-ff8e45d18c89 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.771068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.772565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.772852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.773135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.774109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.777056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.907414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1080/2185] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:10 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:08:10.908989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.928179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c52a0-9548-4910-ad12-a053d84d13b9 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.937567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.938373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.945452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.945452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:10.945452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:10.945452 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:10.964742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1106/2186] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:10.966116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:10.985214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e50a-0f13-433d-8cbd-b31adaa740d5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:10.991419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:10.992380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:10.992828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:10.993259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] PATH_INFO: `/v3/projects/e5bd290b28224c809ba4356e23121a8f/users/8191c45d8c664b1a8353a464ffbce509/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:11.014896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:11.024516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bd290b28224c809ba4356e23121a8f, user_id=8191c45d8c664b1a8353a464ffbce509, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:11.030163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:11.136602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1081/2187] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:10 2022] PUT /identity/v3/projects/e5bd290b28224c809ba4356e23121a8f/users/8191c45d8c664b1a8353a464ffbce509/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:11.142220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:11.155218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cead8-c779-4950-9de8-c3de7dbc9d9f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:11.222012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:11.238589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb98ef7-d243-4859-a2e0-83c718a41f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:11.239968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98ef7-d243-4859-a2e0-83c718a41f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:11.241788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98ef7-d243-4859-a2e0-83c718a41f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:11.242480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98ef7-d243-4859-a2e0-83c718a41f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:11.243597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98ef7-d243-4859-a2e0-83c718a41f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:11.245752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98ef7-d243-4859-a2e0-83c718a41f05 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:11.263915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1107/2188] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:11.264357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:11.293576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4792-a4f4-4768-a104-8a19d4f6d49a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:11.299122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:11.300428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:11.300783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:11.301072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] PATH_INFO: `/v3/projects/e5bd290b28224c809ba4356e23121a8f/users/8191c45d8c664b1a8353a464ffbce509/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:11.303557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bd290b28224c809ba4356e23121a8f, user_id=8191c45d8c664b1a8353a464ffbce509, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:11.306931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:11.324676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1082/2189] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:11 2022] PUT /identity/v3/projects/e5bd290b28224c809ba4356e23121a8f/users/8191c45d8c664b1a8353a464ffbce509/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:11.335228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:11.335799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:11.336169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:11.371421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] MFA Rules not processed for user `8191c45d8c664b1a8353a464ffbce509`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:11.372863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:11.463817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1108/2190] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:11.475525 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:11.477753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:11.549328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab2aa-ea88-4070-8db2-38665ebfd340 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:11.553196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb53ae-7172-44a5-85fa-6178f05c6f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:11.560399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb53ae-7172-44a5-85fa-6178f05c6f5b service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:11.560399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb53ae-7172-44a5-85fa-6178f05c6f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:11.560399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb53ae-7172-44a5-85fa-6178f05c6f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:11.564357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb53ae-7172-44a5-85fa-6178f05c6f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:11.565993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb53ae-7172-44a5-85fa-6178f05c6f5b service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:11.576657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1083/2191] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:11.712988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:11.714416 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:11.726988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d37e15-3cbc-4076-8172-7f729463e2a8 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:11.731285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:11.731920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:11.732291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:11.732625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:11.792238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:11.793725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:11.802881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1109/2192] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:12.298648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca32ac-39b4-461b-b510-bc89eb870117 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:12.299162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca32ac-39b4-461b-b510-bc89eb870117 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:12.299267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca32ac-39b4-461b-b510-bc89eb870117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:12.324182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a1ca32ac-39b4-461b-b510-bc89eb870117 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:12.325453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a1ca32ac-39b4-461b-b510-bc89eb870117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:12.420374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1084/2193] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:12.437520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:12.517318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365ea04-7c4b-4b0b-81d5-e2595ac934f7 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:12.523818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:12.524862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:12.524862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:12.525103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:12.534828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:12.536405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:12.541172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:12.548936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1110/2194] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:13.454531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:13.454531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:13.454531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:13.473698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:13.478761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:13.536709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1085/2195] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:08:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:13.585239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:13.586746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:13.663438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa5d5-aee4-4fb5-aa3d-916f43a66bee service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:13.668454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19e055-4f04-48ac-abd0-de49ab5d5d74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:13.669893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19e055-4f04-48ac-abd0-de49ab5d5d74 service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:13.670317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19e055-4f04-48ac-abd0-de49ab5d5d74 service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:13.670598 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19e055-4f04-48ac-abd0-de49ab5d5d74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:13.679280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19e055-4f04-48ac-abd0-de49ab5d5d74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:13.680929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19e055-4f04-48ac-abd0-de49ab5d5d74 service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:13.690341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1111/2196] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:08:16.969143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:16.983628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8401dd5-4ce3-41dd-8ee2-f23274d90ba6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:16.992056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:16.993181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:16.993711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:16.994358 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] PATH_INFO: `/v3/users/174c59b2f9d84be781e75980e49842bd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:16.995924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174c59b2f9d84be781e75980e49842bd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:16.999522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:17.031270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:17.493028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174c59b2f9d84be781e75980e49842bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:17.577228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174c59b2f9d84be781e75980e49842bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:17.577228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174c59b2f9d84be781e75980e49842bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:17.579735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174c59b2f9d84be781e75980e49842bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:17.594262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174c59b2f9d84be781e75980e49842bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:17.641005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1086/2197] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:16 2022] DELETE /identity/v3/users/174c59b2f9d84be781e75980e49842bd => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:17.645413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d38fc-3577-4e6c-9aa0-2b304b0591eb None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:17.649506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d38fc-3577-4e6c-9aa0-2b304b0591eb None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:17.649506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d38fc-3577-4e6c-9aa0-2b304b0591eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:17.689138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f26d38fc-3577-4e6c-9aa0-2b304b0591eb None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:17.691940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f26d38fc-3577-4e6c-9aa0-2b304b0591eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:17.836835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1112/2198] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:17.848098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:17.850552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:17.966681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734365d-8ee9-4ed6-a038-28018ec8b3a5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:17.970935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:17.971778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:17.972280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:17.972690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:17.987743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:17.989360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:18.001410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1087/2199] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:08:18.690283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:18.690841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:18.691895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:18.720102 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:18.721847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:18.741301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1113/2200] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:18.759565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:18.761359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:18.781419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:18.783211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:18.816731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc68d4-f2bd-450c-8619-2bfc1add9e4e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:18.844486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:18.853984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:18.853984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:18.853984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] PATH_INFO: `/v3/projects/6facad817b8548ffadfd03cd2a6035a1` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:18.853984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6facad817b8548ffadfd03cd2a6035a1)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:18.853984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:18.938390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153b793-6548-4adf-a506-4507dd7556f2 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:18.944182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:18.944950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:18.948615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:18.948615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:18.968191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:18.969838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:18.983000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1088/2201] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:18.997926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6facad817b8548ffadfd03cd2a6035a1', 'request_id': 'req-5a145041-af60-4e78-b10c-66a77e0c92f6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.005905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6facad817b8548ffadfd03cd2a6035a1', 'request_id': 'req-5a145041-af60-4e78-b10c-66a77e0c92f6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.073612 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6facad817b8548ffadfd03cd2a6035a1', 'request_id': 'req-5a145041-af60-4e78-b10c-66a77e0c92f6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.096228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] The token cache is being invalidate because project 6facad817b8548ffadfd03cd2a6035a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:19.096689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.097734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.104668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1114/2202] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:18 2022] DELETE /identity/v3/projects/6facad817b8548ffadfd03cd2a6035a1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:08:19.107032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:19.121819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0356fea-ce7b-4f0c-a5cb-7e079e6fcd91 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:19.185154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:19.250884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:19.251534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:19.251820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:19.252112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] PATH_INFO: `/v3/users/0509acf2e1224b8184fdc098d2ce355f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:19.253457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0509acf2e1224b8184fdc098d2ce355f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:19.256874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:19.460256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0509acf2e1224b8184fdc098d2ce355f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.605082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0509acf2e1224b8184fdc098d2ce355f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.607411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0509acf2e1224b8184fdc098d2ce355f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.608289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0509acf2e1224b8184fdc098d2ce355f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.617506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0509acf2e1224b8184fdc098d2ce355f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:19.658942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1089/2203] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:19 2022] DELETE /identity/v3/users/0509acf2e1224b8184fdc098d2ce355f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:20.291791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:20.294027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:20.303667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:20.312549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145041-af60-4e78-b10c-66a77e0c92f6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:20.389447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:20.390215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:20.390595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:20.390970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] PATH_INFO: `/v3/projects/2c32cb6481c941daa35f20d1cc4b20de` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:20.392235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c32cb6481c941daa35f20d1cc4b20de)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:20.394305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:20.557872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c32cb6481c941daa35f20d1cc4b20de', 'request_id': 'req-d71ec740-2a7d-482f-8f56-c38bd386cd5e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:20.568422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c32cb6481c941daa35f20d1cc4b20de', 'request_id': 'req-d71ec740-2a7d-482f-8f56-c38bd386cd5e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:20.644224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c32cb6481c941daa35f20d1cc4b20de', 'request_id': 'req-d71ec740-2a7d-482f-8f56-c38bd386cd5e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:20.663866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] The token cache is being invalidate because project 2c32cb6481c941daa35f20d1cc4b20de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:20.664176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:20.668227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:20.671989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1115/2204] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:20 2022] DELETE /identity/v3/projects/2c32cb6481c941daa35f20d1cc4b20de => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:20.676652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:20.679109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:20.702994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f82928-c6b5-4d04-953f-89b760a4cb95 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:20.790030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:20.790772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:20.791155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:20.791503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] PATH_INFO: `/v3/users/8191c45d8c664b1a8353a464ffbce509` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:20.792876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8191c45d8c664b1a8353a464ffbce509)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:20.795724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:21.003978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8191c45d8c664b1a8353a464ffbce509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:21.005802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:21.108644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8191c45d8c664b1a8353a464ffbce509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:21.109327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8191c45d8c664b1a8353a464ffbce509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:21.110349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8191c45d8c664b1a8353a464ffbce509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:21.127628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3e3c87d2-16d8-475c-a1ed-ea3bbc68b3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8191c45d8c664b1a8353a464ffbce509'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:21.172064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1090/2205] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:20 2022] DELETE /identity/v3/users/8191c45d8c664b1a8353a464ffbce509 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:22.024585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:22.027031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:22.047260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ec740-2a7d-482f-8f56-c38bd386cd5e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:22.123845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:22.124844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:22.125318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:22.125796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] PATH_INFO: `/v3/projects/e5bd290b28224c809ba4356e23121a8f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:22.127187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bd290b28224c809ba4356e23121a8f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:22.130382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:22.247164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:22.267210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bd290b28224c809ba4356e23121a8f', 'request_id': 'req-2305919f-eb7c-4358-bd27-f51a553bd399'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:22.280621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bd290b28224c809ba4356e23121a8f', 'request_id': 'req-2305919f-eb7c-4358-bd27-f51a553bd399'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:22.382793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bd290b28224c809ba4356e23121a8f', 'request_id': 'req-2305919f-eb7c-4358-bd27-f51a553bd399'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:22.415697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] The token cache is being invalidate because project e5bd290b28224c809ba4356e23121a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:22.418257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:22.418257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-2305919f-eb7c-4358-bd27-f51a553bd399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:22.420417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1116/2206] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:22 2022] DELETE /identity/v3/projects/e5bd290b28224c809ba4356e23121a8f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:22.430917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:22.431424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:22.431656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:22.468627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:22.470009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:22.570994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1091/2207] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:22.582044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:22.582231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:22.582514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:22.608603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:22.610092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:22.630892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1117/2208] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:22.631732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:22.645315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef2ef3-1246-45ab-91fe-e4ed726223a0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:22.651131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:22.651839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:22.652208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:22.652620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:22.653353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:08:22.653726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:22.655402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:22.672827 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1092/2209] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:08:22.677272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:22.688707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02009cc7-0d43-40f8-bdd6-99ac8337a7ea None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:22.695316 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ffac6-da42-426a-862f-7d77c7a46543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:22.696406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ffac6-da42-426a-862f-7d77c7a46543 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:22.696406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ffac6-da42-426a-862f-7d77c7a46543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:22.696700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ffac6-da42-426a-862f-7d77c7a46543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:22.697311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ffac6-da42-426a-862f-7d77c7a46543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:22.699228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ffac6-da42-426a-862f-7d77c7a46543 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:22.859610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:22.861561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1118/2210] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:22 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:22.873544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b38e9-99c4-49e8-aae3-abd9c47320aa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:22.968608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:22.969238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:22.969523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:22.969801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:22.970510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:22.972697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:23.041014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.044720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.052986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.071465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:23.075153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:23.087109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1093/2211] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:22 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:23.087109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:23.092112 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1119/2212] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:23.115998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:23.117962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:23.125177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9d509-739f-44ff-9916-96ee1699612d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:23.140209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:23.141704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.143966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.144468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.149548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:23.150368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:23.176644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1094/2213] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:08:23.178992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:23.208334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ac97-2e67-4820-86fc-40ee1ae7c97f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:23.208334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:23.208334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.208334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.208875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.208875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:23.212642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:23.251496 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1095/2214] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:23.259904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:23.282816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ec0d4-d671-47d5-9526-20b2f826d9fb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:23.289687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:23.292751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.293305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.294026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] PATH_INFO: `/v3/projects/7d014cecbb854e359c2765ff301ab3d3/users/ecc9120705d5451aa4a46cda9002ec49/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.295737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a09be-78e9-4f71-bef5-d6dfe77b4bc0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:23.315173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d014cecbb854e359c2765ff301ab3d3, user_id=ecc9120705d5451aa4a46cda9002ec49, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:23.317747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b248d-0137-4640-8629-9535f8df297b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:23.319099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b248d-0137-4640-8629-9535f8df297b service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.319355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:23.319498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b248d-0137-4640-8629-9535f8df297b service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.319868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b248d-0137-4640-8629-9535f8df297b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.325221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:23.344194 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b248d-0137-4640-8629-9535f8df297b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:23.345995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b248d-0137-4640-8629-9535f8df297b service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:23.361897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1120/2215] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:08:23.384740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1096/2216] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:23 2022] PUT /identity/v3/projects/7d014cecbb854e359c2765ff301ab3d3/users/ecc9120705d5451aa4a46cda9002ec49/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:23.390273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6977b4-bd4e-4538-9a38-aca980740cb7 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.390675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6977b4-bd4e-4538-9a38-aca980740cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.391059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6977b4-bd4e-4538-9a38-aca980740cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.460673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4e6977b4-bd4e-4538-9a38-aca980740cb7 None None] MFA Rules not processed for user `ecc9120705d5451aa4a46cda9002ec49`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:23.462657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4e6977b4-bd4e-4538-9a38-aca980740cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:23.659001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1121/2217] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:23.664406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:23.667309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:23.775280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590cdbc-9536-47a1-86d9-b104decd6745 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:23.779484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa0b1-b919-4529-acca-3909c3419c17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:23.780091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa0b1-b919-4529-acca-3909c3419c17 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:23.780430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa0b1-b919-4529-acca-3909c3419c17 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:23.780711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa0b1-b919-4529-acca-3909c3419c17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:23.790865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa0b1-b919-4529-acca-3909c3419c17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:23.792294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa0b1-b919-4529-acca-3909c3419c17 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:23.810456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1097/2218] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:33.643994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:33.805455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=28 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:41.794028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e6cd-bd65-4a85-b594-c0864d5aa6c0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:41.794656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e6cd-bd65-4a85-b594-c0864d5aa6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:41.795048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e6cd-bd65-4a85-b594-c0864d5aa6c0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:41.796792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1122/2219] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:08:41.808629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4fe0b-5ff7-40e6-852f-28c733bc7f71 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:41.809088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4fe0b-5ff7-40e6-852f-28c733bc7f71 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:41.809368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4fe0b-5ff7-40e6-852f-28c733bc7f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:41.830739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0cd4fe0b-5ff7-40e6-852f-28c733bc7f71 None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:41.831939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0cd4fe0b-5ff7-40e6-852f-28c733bc7f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:41.901036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1098/2220] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:08:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:41.913006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e6cd-bd65-4a85-b594-c0864d5aa6c0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:41.914655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8442e6cd-bd65-4a85-b594-c0864d5aa6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:41.927921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e6cd-bd65-4a85-b594-c0864d5aa6c0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:41.931377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455911-a712-46de-a1cc-e164a33360b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:41.931964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455911-a712-46de-a1cc-e164a33360b8 service glance] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:41.932238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455911-a712-46de-a1cc-e164a33360b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:41.932540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455911-a712-46de-a1cc-e164a33360b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:41.942370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455911-a712-46de-a1cc-e164a33360b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:41.943765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a455911-a712-46de-a1cc-e164a33360b8 service glance] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:41.954298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1123/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:08:42.146984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb9b07-552d-4fd6-aa41-f5b28b2d295d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:42.148115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb9b07-552d-4fd6-aa41-f5b28b2d295d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:42.148115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb9b07-552d-4fd6-aa41-f5b28b2d295d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:42.152519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1099/2222] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:08:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:08:42.156266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c8c4b-71ad-4a95-a36d-1bbf819a36b0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:42.156592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c8c4b-71ad-4a95-a36d-1bbf819a36b0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:42.156866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c8c4b-71ad-4a95-a36d-1bbf819a36b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:42.178979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-818c8c4b-71ad-4a95-a36d-1bbf819a36b0 None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:42.180686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-818c8c4b-71ad-4a95-a36d-1bbf819a36b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:42.232772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1124/2223] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:42.244637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb9b07-552d-4fd6-aa41-f5b28b2d295d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:42.246371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-befb9b07-552d-4fd6-aa41-f5b28b2d295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:42.259825 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb9b07-552d-4fd6-aa41-f5b28b2d295d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:42.264287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75969a-0519-45e3-aaa6-c449dcb0efe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:42.264919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75969a-0519-45e3-aaa6-c449dcb0efe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:42.265202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75969a-0519-45e3-aaa6-c449dcb0efe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:42.265477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75969a-0519-45e3-aaa6-c449dcb0efe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:42.272716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75969a-0519-45e3-aaa6-c449dcb0efe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:42.277586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75969a-0519-45e3-aaa6-c449dcb0efe0 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:42.282844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1100/2224] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:42.368590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b507-042f-4100-a2e3-7562b127b5ae None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:42.368887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b507-042f-4100-a2e3-7562b127b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:42.369170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b507-042f-4100-a2e3-7562b127b5ae None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:42.371352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1125/2225] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:08:42.379312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b28c-37aa-4cb7-9fec-6aa956fd3bcc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:42.379599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b28c-37aa-4cb7-9fec-6aa956fd3bcc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:42.381111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47b28c-37aa-4cb7-9fec-6aa956fd3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:42.407785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2b47b28c-37aa-4cb7-9fec-6aa956fd3bcc None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:42.407785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b47b28c-37aa-4cb7-9fec-6aa956fd3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:42.418397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1101/2226] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:42.429827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b507-042f-4100-a2e3-7562b127b5ae None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:42.441398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b507-042f-4100-a2e3-7562b127b5ae None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:42.445099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:42.445832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:42.446171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:42.446469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:42.456609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:42.458093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:42.469764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1126/2227] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:46.300428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b44ce-d268-44e9-961c-cf489a558b60 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:46.300950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b44ce-d268-44e9-961c-cf489a558b60 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:46.301111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b44ce-d268-44e9-961c-cf489a558b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:46.321150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-823b44ce-d268-44e9-961c-cf489a558b60 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:46.322338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-823b44ce-d268-44e9-961c-cf489a558b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:46.378656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1102/2228] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:08:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:46.390561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:46.392013 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:46.429539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ee8e1-6dc2-47b2-90df-0587c4e32c37 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:46.429852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ee8e1-6dc2-47b2-90df-0587c4e32c37 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:46.430134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ee8e1-6dc2-47b2-90df-0587c4e32c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:46.448950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9b4ee8e1-6dc2-47b2-90df-0587c4e32c37 None None] MFA Rules not processed for user `4425a62bd8c64c1c85a5d8c7dde54bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:46.450152 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9b4ee8e1-6dc2-47b2-90df-0587c4e32c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:46.462062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eed5e6-0824-49f8-96f9-77ff52dde0de service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:46.467881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:46.468512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:46.468794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:46.469063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:46.477077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:46.478632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:46.487817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1127/2229] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:08:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:08:46.509544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1103/2230] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:08:50.929487 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:50.998854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c85ea-56b9-44a6-9738-70a84c331201 service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:51.003581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:51.004223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:51.004530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:51.004827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] PATH_INFO: `/v3/users/ecc9120705d5451aa4a46cda9002ec49` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:51.005981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc9120705d5451aa4a46cda9002ec49)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:51.007919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:51.022873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:51.229850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc9120705d5451aa4a46cda9002ec49'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:51.305464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc9120705d5451aa4a46cda9002ec49'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:51.306103 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc9120705d5451aa4a46cda9002ec49'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:51.306763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc9120705d5451aa4a46cda9002ec49'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:51.316633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc9120705d5451aa4a46cda9002ec49'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:51.335625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1128/2231] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:08:50 2022] DELETE /identity/v3/users/ecc9120705d5451aa4a46cda9002ec49 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:51.341097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:51.341642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:51.342010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:51.363452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:51.364712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:51.383563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:51.430239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1104/2232] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:51.442873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:51.444367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:51.521158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1601c-6bde-47f4-8642-7eaf7c1edd63 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:51.526609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814202c-2dd5-489c-b9da-6f0492400e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:51.527287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814202c-2dd5-489c-b9da-6f0492400e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:51.527926 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814202c-2dd5-489c-b9da-6f0492400e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:51.528101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814202c-2dd5-489c-b9da-6f0492400e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:51.539085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814202c-2dd5-489c-b9da-6f0492400e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:51.542455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814202c-2dd5-489c-b9da-6f0492400e03 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:51.554548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1129/2233] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:52.019818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:52.021297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:52.044482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14b1c-1795-4e1c-b3d9-10d398df736e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:52.049136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:52.049888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:52.050165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:52.050441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] PATH_INFO: `/v3/projects/7d014cecbb854e359c2765ff301ab3d3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:52.051602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d014cecbb854e359c2765ff301ab3d3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:52.053536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:52.433945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d014cecbb854e359c2765ff301ab3d3', 'request_id': 'req-9f134366-42da-480a-954a-63b9ec7f7193'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:52.441709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d014cecbb854e359c2765ff301ab3d3', 'request_id': 'req-9f134366-42da-480a-954a-63b9ec7f7193'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:52.551362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d014cecbb854e359c2765ff301ab3d3', 'request_id': 'req-9f134366-42da-480a-954a-63b9ec7f7193'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:52.564364 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] The token cache is being invalidate because project 7d014cecbb854e359c2765ff301ab3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:08:52.564642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:52.565316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f134366-42da-480a-954a-63b9ec7f7193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:08:52.567018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1105/2234] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:08:52 2022] DELETE /identity/v3/projects/7d014cecbb854e359c2765ff301ab3d3 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:08:52.571832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:52.572478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:52.572635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:52.593509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:52.606920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:52.681545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1130/2235] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:52.692248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:52.693169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:52.693599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:52.717470 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:52.718687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:52.727667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1106/2236] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:52.732707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:52.749281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea38f5-f36e-489d-a126-83b43176dbad None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:52.754319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:52.755268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:52.755649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:52.756741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:52.757476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:08:52.757856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:52.759509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:52.774765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1131/2237] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:08:52.779609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:52.789574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a91190-a1ee-4773-8916-61c90a09033d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:52.795365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:52.795977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:52.796414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:52.796691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:52.797575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:52.799505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:52.901345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1107/2238] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:08:52 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:52.906264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:52.917634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5463-6c04-48cb-bbe1-c0eada0a3430 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:52.941824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:52.999147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:53.000410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:53.000410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:53.000410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:53.001088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:53.003203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:53.120571 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1132/2239] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:08:52 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:08:53.122276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:53.133012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae3d85-f089-42d0-ac6d-8fbdcd38f739 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:53.139165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:53.139788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:53.140072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:53.140411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:53.145707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:53.145707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:53.152788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1108/2240] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:53.163036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:53.174390 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2c4c-da97-4623-bcfb-dbe2d319c608 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:53.180106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3628d-021e-4b57-b3f9-8a679eb9ca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:53.180751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3628d-021e-4b57-b3f9-8a679eb9ca97 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:53.181032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3628d-021e-4b57-b3f9-8a679eb9ca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:53.181319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3628d-021e-4b57-b3f9-8a679eb9ca97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:53.181966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3628d-021e-4b57-b3f9-8a679eb9ca97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:53.183556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3628d-021e-4b57-b3f9-8a679eb9ca97 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:53.195898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1133/2241] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:08:53.200324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:53.210951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139daf2-51e3-4d39-bd0d-41f53232c336 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:53.215888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:53.216676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:53.216961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:53.217235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] PATH_INFO: `/v3/projects/d13cc7c95f394dc68e86826f5d99f3ea/users/16645cc7878c414aa22a514f44b40a43/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:53.233237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13cc7c95f394dc68e86826f5d99f3ea, user_id=16645cc7878c414aa22a514f44b40a43, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:53.235972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:53.511855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1109/2242] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:08:53 2022] PUT /identity/v3/projects/d13cc7c95f394dc68e86826f5d99f3ea/users/16645cc7878c414aa22a514f44b40a43/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:08:53.523807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449cf0d-1817-414c-ac8b-a33259a317b4 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:53.524098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449cf0d-1817-414c-ac8b-a33259a317b4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:53.524409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449cf0d-1817-414c-ac8b-a33259a317b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:53.560590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2449cf0d-1817-414c-ac8b-a33259a317b4 None None] MFA Rules not processed for user `16645cc7878c414aa22a514f44b40a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:53.561842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2449cf0d-1817-414c-ac8b-a33259a317b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:53.637633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1134/2243] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:53.647100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:53.648904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:53.709652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:08:53.723232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccef8a-8280-466a-b12c-cb1a59e02c27 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:53.726912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:53.727551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:53.727833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:53.728109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:53.738181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:53.753526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:53.753526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1110/2244] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:55.440843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:55.441456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:55.441456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:55.462723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] MFA Rules not processed for user `16645cc7878c414aa22a514f44b40a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:08:55.463955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:55.475211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1135/2245] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:08:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:08:59.612411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:59.614281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:59.670283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:08:59.672374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:59.737222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67a03b-bda3-4eb2-8937-3789c0aca8cd service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:59.743032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:59.743657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:59.744080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:59.744387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:59.746685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:08:59.760143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:59.763081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6521eb0-367b-449e-8bf3-bc2b560523f3 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:59.771933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639d232-3e7a-4b19-960d-5f6076e65146 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:08:59.775709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1111/2246] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:08:59.779997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:08:59.780654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:08:59.780935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:08:59.781208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:08:59.790972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:08:59.794958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:08:59.805769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1136/2247] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:08:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:09:05.766263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779ea4-26c2-4098-a0de-b14682c0ece0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:05.767090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779ea4-26c2-4098-a0de-b14682c0ece0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:05.767262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779ea4-26c2-4098-a0de-b14682c0ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:05.786832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a3779ea4-26c2-4098-a0de-b14682c0ece0 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:05.788050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3779ea4-26c2-4098-a0de-b14682c0ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:05.845239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1112/2248] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 15 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:09:05.859502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:05.861040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:05.875840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:05.959373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7b2bf-14cf-4993-8af1-9fe3771c484a service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:05.966462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:05.967508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:05.967791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:05.968072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:05.979212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:05.981899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:05.999143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1137/2249] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:09:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:09:15.837980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=64 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:15.987074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=26 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:21.665380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6cfa-0fa8-496e-b37a-51450d8b474d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:21.665865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6cfa-0fa8-496e-b37a-51450d8b474d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:21.665980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c6cfa-0fa8-496e-b37a-51450d8b474d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:21.688211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1d4c6cfa-0fa8-496e-b37a-51450d8b474d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:21.689446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d4c6cfa-0fa8-496e-b37a-51450d8b474d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:21.753073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1113/2250] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:21.775246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:21.776890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:21.858245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfde5a-8177-4301-b3b8-a4b550aa724b service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:21.866482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:21.867098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:21.867406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:21.867735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:21.877304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:21.879071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:21.889273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1138/2251] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:09:26.981229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa05a-cdec-4e49-9cbe-cce54bf2b7ca None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:26.982044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa05a-cdec-4e49-9cbe-cce54bf2b7ca None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:26.987267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fa05a-cdec-4e49-9cbe-cce54bf2b7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:27.003236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-634fa05a-cdec-4e49-9cbe-cce54bf2b7ca None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:27.004622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-634fa05a-cdec-4e49-9cbe-cce54bf2b7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:27.013169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1114/2252] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:09:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:27.044806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:27.063098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46c553-5068-4fc4-b3c2-52560c89ebca service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:27.071683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:27.072334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:27.072624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:27.072904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:27.086299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:27.088181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:27.097965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1139/2253] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:09:28.345280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234404-4350-4f6e-9819-73d22d546168 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:28.345763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234404-4350-4f6e-9819-73d22d546168 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:28.346002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3234404-4350-4f6e-9819-73d22d546168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:28.365948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c3234404-4350-4f6e-9819-73d22d546168 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:28.367141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c3234404-4350-4f6e-9819-73d22d546168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:28.376163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1115/2254] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 15 11:09:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:28.388788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:28.399792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d32f6c-523d-43fa-b904-646d0f93dbeb service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:28.404816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:28.405495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:28.405779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:28.406054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:28.414455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:28.416072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:28.425160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1140/2255] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:09:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 11:09:29.060334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b22f6-c885-4a30-90e2-116ec3a6aaaf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:29.060634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b22f6-c885-4a30-90e2-116ec3a6aaaf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:29.060913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b22f6-c885-4a30-90e2-116ec3a6aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:29.081879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-972b22f6-c885-4a30-90e2-116ec3a6aaaf None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:29.083245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-972b22f6-c885-4a30-90e2-116ec3a6aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:29.090991 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1116/2256] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:29.102964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:29.120347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c40e-f6ea-4967-a3cd-77743d8a9b3a service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:29.126539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:29.127261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:29.127615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:29.128022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:29.136563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:29.138135 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:29.146835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1141/2257] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:09:29.288082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8dc24-0c77-4eb7-98d3-47ad69e3be41 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:29.288396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8dc24-0c77-4eb7-98d3-47ad69e3be41 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:29.288672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8dc24-0c77-4eb7-98d3-47ad69e3be41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:29.308475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ffd8dc24-0c77-4eb7-98d3-47ad69e3be41 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:29.309957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ffd8dc24-0c77-4eb7-98d3-47ad69e3be41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:29.318954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1117/2258] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:29.345198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:29.346711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:29.362377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce339c-a37c-43c2-8357-a233b84df026 service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:29.368009 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:29.368659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:29.368938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:29.369205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:29.378092 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:29.379226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:29.388949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1142/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:09:29.912469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def16f7-87ae-4848-b57c-396c327c55f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:29.912969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def16f7-87ae-4848-b57c-396c327c55f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:29.913337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def16f7-87ae-4848-b57c-396c327c55f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:29.939916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1def16f7-87ae-4848-b57c-396c327c55f7 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:29.941192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1def16f7-87ae-4848-b57c-396c327c55f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:29.952565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1118/2260] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 15 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:09:29.971545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:29.982188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205294b-e2e7-43b3-acbf-265fc0b6d2d4 service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:29.987840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:29.988499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:29.988786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:29.989064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:29.997586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:30.000123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:30.008417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1143/2261] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:09:32.176111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4ac5-4583-4207-a67b-0ff58f7e23fd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:32.179998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4ac5-4583-4207-a67b-0ff58f7e23fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:32.179998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a4ac5-4583-4207-a67b-0ff58f7e23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:32.195936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-555a4ac5-4583-4207-a67b-0ff58f7e23fd None None] MFA Rules not processed for user `5111139cdb444281b95871311f9c7f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:32.197122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-555a4ac5-4583-4207-a67b-0ff58f7e23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:32.254624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1119/2262] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:09:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:32.699258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:32.711030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d35b3-113f-434c-8861-45f9537ca605 service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:32.718170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:32.718938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:32.719389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:32.719782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] PATH_INFO: `/v3/users/16645cc7878c414aa22a514f44b40a43` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:32.721027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16645cc7878c414aa22a514f44b40a43)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:32.723007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:32.889224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16645cc7878c414aa22a514f44b40a43'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:32.959855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16645cc7878c414aa22a514f44b40a43'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:32.960522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16645cc7878c414aa22a514f44b40a43'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:32.961136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16645cc7878c414aa22a514f44b40a43'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:32.969283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16645cc7878c414aa22a514f44b40a43'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:32.978792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:33.002117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1144/2263] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:09:32 2022] DELETE /identity/v3/users/16645cc7878c414aa22a514f44b40a43 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:09:33.006886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180fbb2-4884-4809-8c67-497ceb68b715 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:33.007159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180fbb2-4884-4809-8c67-497ceb68b715 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:33.007440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180fbb2-4884-4809-8c67-497ceb68b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:33.056500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b180fbb2-4884-4809-8c67-497ceb68b715 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:33.056500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b180fbb2-4884-4809-8c67-497ceb68b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:33.143626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1120/2264] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:33.161774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:33.164695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:33.203842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:33.204351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:33.204446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:33.227633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:33.228917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:33.238362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1121/2265] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:33.265663 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f19fb7-ed3e-4f13-82d8-bc122469266b admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:33.266526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:33.268509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:33.270924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:33.271525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:33.273876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:33.273876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:33.278845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:33.285125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:33.291053 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:33.298526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1145/2266] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:09:33.353585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe130-c05b-4bc5-b44d-2986e8e442e6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:33.360535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028542ed-8830-4832-b63d-e3bcaf2a37d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:33.361245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028542ed-8830-4832-b63d-e3bcaf2a37d1 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:33.361596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028542ed-8830-4832-b63d-e3bcaf2a37d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:33.361978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028542ed-8830-4832-b63d-e3bcaf2a37d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:33.370620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028542ed-8830-4832-b63d-e3bcaf2a37d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:33.372556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028542ed-8830-4832-b63d-e3bcaf2a37d1 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:33.383208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1122/2267] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:09:33.546872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:33.548528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:33.563783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5f9b7-b785-499d-a9e8-63255c2aba9d service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:33.570530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:33.571234 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:33.571602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:33.571838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] PATH_INFO: `/v3/projects/d13cc7c95f394dc68e86826f5d99f3ea` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:33.573506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13cc7c95f394dc68e86826f5d99f3ea)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:33.577326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:33.757270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13cc7c95f394dc68e86826f5d99f3ea', 'request_id': 'req-6e376bd3-671f-459d-8797-99900a326dff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:33.765649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13cc7c95f394dc68e86826f5d99f3ea', 'request_id': 'req-6e376bd3-671f-459d-8797-99900a326dff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:33.881011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13cc7c95f394dc68e86826f5d99f3ea', 'request_id': 'req-6e376bd3-671f-459d-8797-99900a326dff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:33.892518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] The token cache is being invalidate because project d13cc7c95f394dc68e86826f5d99f3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:09:33.892810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:33.893429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:09:33.894896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1146/2268] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:09:33 2022] DELETE /identity/v3/projects/d13cc7c95f394dc68e86826f5d99f3ea => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:09:37.501498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267ee-fe87-4441-9237-0dbd5aad9b1c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:37.502011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267ee-fe87-4441-9237-0dbd5aad9b1c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:37.502096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267ee-fe87-4441-9237-0dbd5aad9b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:37.526226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6db267ee-fe87-4441-9237-0dbd5aad9b1c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:37.527616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6db267ee-fe87-4441-9237-0dbd5aad9b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:37.601341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1123/2269] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:09:37.649221 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:37.650966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:37.730935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376bd3-671f-459d-8797-99900a326dff admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:37.737754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:37.738365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:37.739752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:37.740024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:37.752372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:37.753967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:37.764111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1147/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:09:40.772236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340cd28-36be-4fe9-bd07-437be2949afe None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:40.772758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340cd28-36be-4fe9-bd07-437be2949afe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:40.772855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340cd28-36be-4fe9-bd07-437be2949afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:40.797613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9340cd28-36be-4fe9-bd07-437be2949afe None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:40.798727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9340cd28-36be-4fe9-bd07-437be2949afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:40.807457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1124/2271] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Sep 15 11:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:09:40.836609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:09:40.838089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:40.848352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:40.853761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895b77b-2b5d-4b15-ab9d-7cf188d604af service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:09:40.859656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145faa5a-9c08-4e62-8f0b-3e7da797483f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:09:40.861432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faa5a-9c08-4e62-8f0b-3e7da797483f service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:40.861432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faa5a-9c08-4e62-8f0b-3e7da797483f service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:40.861432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faa5a-9c08-4e62-8f0b-3e7da797483f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:40.869910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145faa5a-9c08-4e62-8f0b-3e7da797483f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:09:40.871476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145faa5a-9c08-4e62-8f0b-3e7da797483f service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:09:40.883169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1148/2272] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:09:50.794348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=61 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:50.913881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:09:55.084701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:09:55.085301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:09:55.085301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:09:55.105207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] MFA Rules not processed for user `d8d1da88813d49cf9abb7b626a94259e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:09:55.106421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:09:55.166040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1125/2273] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:10:04.338932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:10:04.339511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:10:04.339772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:10:04.360633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] MFA Rules not processed for user `39133da0b7e049f09431c6e3d015f567`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:10:04.361882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:10:04.424826 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1149/2274] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:10:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:10:05.157895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=25 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:10:14.417804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=25 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:10:15.509270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:10:15.510776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:10:15.525461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e68cd9-d3e8-4af5-a92a-fc105f563654 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:10:15.529906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:10:15.530606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:10:15.530883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:10:15.531154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] PATH_INFO: `/v3/users/4425a62bd8c64c1c85a5d8c7dde54bd7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:10:15.532242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4425a62bd8c64c1c85a5d8c7dde54bd7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:10:15.534188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:10:15.737723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4425a62bd8c64c1c85a5d8c7dde54bd7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:15.814638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4425a62bd8c64c1c85a5d8c7dde54bd7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:15.815246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4425a62bd8c64c1c85a5d8c7dde54bd7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:15.815859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4425a62bd8c64c1c85a5d8c7dde54bd7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:15.823173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d7f6c78d-a2ad-4747-bea6-7afb7dac4a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4425a62bd8c64c1c85a5d8c7dde54bd7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:15.840927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1126/2275] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:10:15 2022] DELETE /identity/v3/users/4425a62bd8c64c1c85a5d8c7dde54bd7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:10:16.085888 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:10:16.096864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1db28-42ee-4fa5-9205-5e1e0c47611b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:10:16.154811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:10:16.155348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:10:16.155624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:10:16.155893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] PATH_INFO: `/v3/projects/262cf586a8a64c68ba5e5be10fc8915b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:10:16.157012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262cf586a8a64c68ba5e5be10fc8915b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:10:16.158899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:10:16.279450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262cf586a8a64c68ba5e5be10fc8915b', 'request_id': 'req-a628d367-c062-4f70-89ce-57429009dfe5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:16.285743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262cf586a8a64c68ba5e5be10fc8915b', 'request_id': 'req-a628d367-c062-4f70-89ce-57429009dfe5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:16.386123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262cf586a8a64c68ba5e5be10fc8915b', 'request_id': 'req-a628d367-c062-4f70-89ce-57429009dfe5'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:16.397196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] The token cache is being invalidate because project 262cf586a8a64c68ba5e5be10fc8915b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:10:16.397485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:16.398097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a628d367-c062-4f70-89ce-57429009dfe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:10:16.399568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1150/2276] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:10:16 2022] DELETE /identity/v3/projects/262cf586a8a64c68ba5e5be10fc8915b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:10:25.837519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:10:26.394008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:10:26.416958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:10:26.417261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:10:26.417541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:10:26.436867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] MFA Rules not processed for user `0ea736407a9846e9899e10a8320e692a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:10:26.438067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:10:26.495755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1127/2277] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:10:36.488293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=25 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:10:49.688997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57816b-f3aa-4f11-aa86-e7d8037c0439 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:10:49.692735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57816b-f3aa-4f11-aa86-e7d8037c0439 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:10:49.692735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57816b-f3aa-4f11-aa86-e7d8037c0439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:10:49.710756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3a57816b-f3aa-4f11-aa86-e7d8037c0439 None None] MFA Rules not processed for user `5111139cdb444281b95871311f9c7f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:10:49.711947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3a57816b-f3aa-4f11-aa86-e7d8037c0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:10:49.765527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1151/2278] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:10:59.758839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=25 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:10:59.959511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:10:59.961118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:00.021742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02704f5b-2149-40ec-a084-f7a052fb90dc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:00.025283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:00.025914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:00.026192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:00.026462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:00.032095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:00.107332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:00.109169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f25344-7fbf-41ac-9c9d-a1ea207c72dc service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:00.123424 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1128/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:04.319754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70c9b-7d54-4ea6-839a-56f078c54de0 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:04.320343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70c9b-7d54-4ea6-839a-56f078c54de0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:04.320343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70c9b-7d54-4ea6-839a-56f078c54de0 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:04.321784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1152/2280] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 11:11:04.350279 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:04.353749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:04.353749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:04.371674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] MFA Rules not processed for user `ee29a4f477544f63be347989e4b549cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:04.372911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:04.436914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1129/2281] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:04.449798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be70c9b-7d54-4ea6-839a-56f078c54de0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:04.451392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6be70c9b-7d54-4ea6-839a-56f078c54de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:04.454964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:04.456998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:04.469220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be70c9b-7d54-4ea6-839a-56f078c54de0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:04.471465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8451b-2a1d-47c0-90e2-7cb86d61265d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:04.474349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:04.475302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:04.475581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:04.475855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] PATH_INFO: `/v3/users/d8d1da88813d49cf9abb7b626a94259e` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:04.476168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:04.476875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:04.477117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d1da88813d49cf9abb7b626a94259e)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:04.477527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:04.477806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:04.479260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:04.486875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:04.490361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:04.498335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1130/2282] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:11:04.661604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d1da88813d49cf9abb7b626a94259e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:04.732485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d1da88813d49cf9abb7b626a94259e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:04.733127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d1da88813d49cf9abb7b626a94259e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:04.733751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d1da88813d49cf9abb7b626a94259e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:04.741843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-41a08efc-6ddc-42de-82c7-4852393e0d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d1da88813d49cf9abb7b626a94259e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:04.759658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1153/2283] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:11:04 2022] DELETE /identity/v3/users/d8d1da88813d49cf9abb7b626a94259e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:05.009936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.023609 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52427ab3-9ddd-4d33-add1-cff73b45e4b9 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.061131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:05.091411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.092050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.092351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.092635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] PATH_INFO: `/v3/projects/9dffbf8b5d1141308592ef8a2ca7fc95` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.093766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dffbf8b5d1141308592ef8a2ca7fc95)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.095689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.232199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dffbf8b5d1141308592ef8a2ca7fc95', 'request_id': 'req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:05.238738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dffbf8b5d1141308592ef8a2ca7fc95', 'request_id': 'req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:05.298557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dffbf8b5d1141308592ef8a2ca7fc95', 'request_id': 'req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:05.312540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] The token cache is being invalidate because project 9dffbf8b5d1141308592ef8a2ca7fc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:11:05.312796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:05.313546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aa476bcf-0ef4-405c-a7c6-9db4796e5f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:05.315162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1131/2284] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:11:05 2022] DELETE /identity/v3/projects/9dffbf8b5d1141308592ef8a2ca7fc95 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:05.321312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.321809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.321931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.343413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:05.344651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:05.405501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1154/2285] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:11:05.413920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.414425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.414545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.434372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:05.435568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:05.443519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1132/2286] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:05.447964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.457567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6667-d553-4e93-8d2a-31f0fe2b462b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.462708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.463301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.463586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.463865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.464595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:11:05.464931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.466510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.478930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1155/2287] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:11:05.493426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.502531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45dabb-61e2-4dec-85d8-321a29ae84e5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.507293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.507895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.508186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.508508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.509157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.511913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.585266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1133/2288] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:11:05 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:05.589641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.600374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73d1dd-7847-4231-be54-eae4404a4ae5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.664957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.665556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.665829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.666095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.666723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.668631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.676365 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:05.755008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1156/2289] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:11:05 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:05.759998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.770266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab661-6399-436e-a666-0b3326022fc0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.775774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.776402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.781552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.781552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.781552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.781552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.794423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1134/2290] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:11:05.795575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.808972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a10d9-83c2-4a13-9ff0-7c2f8ed0553f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.814602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74746dbb-e60e-4a70-82bf-9cc7b8d2e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.815243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746dbb-e60e-4a70-82bf-9cc7b8d2e54e admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.815529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746dbb-e60e-4a70-82bf-9cc7b8d2e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.815801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74746dbb-e60e-4a70-82bf-9cc7b8d2e54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.816591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74746dbb-e60e-4a70-82bf-9cc7b8d2e54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.818197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74746dbb-e60e-4a70-82bf-9cc7b8d2e54e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.829696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1157/2291] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:11:05.833840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:05.843964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9568d-47e0-47d4-9763-3af3548bd22f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:05.848688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:05.851193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.851193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.851193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] PATH_INFO: `/v3/projects/d8fb1a9447fb4067b1ae5e272ffe6d9e/users/888acd6e1e644051b1f4ca0c16047fde/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:05.866731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fb1a9447fb4067b1ae5e272ffe6d9e, user_id=888acd6e1e644051b1f4ca0c16047fde, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:05.869570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:05.961410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1135/2292] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:05 2022] PUT /identity/v3/projects/d8fb1a9447fb4067b1ae5e272ffe6d9e/users/888acd6e1e644051b1f4ca0c16047fde/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:05.973081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:05.973381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:05.974160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:06.002634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] MFA Rules not processed for user `888acd6e1e644051b1f4ca0c16047fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:06.003887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:06.069994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1158/2293] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:06.080837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:06.082531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:06.139957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:06.156619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc18491-a3ca-4979-a196-57d5c96169db admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:06.162941 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:06.163876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:06.163982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:06.164231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:06.173844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:06.175453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:06.184695 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1136/2294] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:06.391709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:06.393228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:06.451681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca46efe-336c-4c3c-8c15-795c2e8d889d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:06.455242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:06.455836 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:06.470148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:06.470148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:06.470148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:06.516180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:06.517731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:06.536509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1159/2295] 10.222.0.26 () {60 vars in 1396 bytes} [Thu Sep 15 11:11:06 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:06.993349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:07.004272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad652f6-a7d2-4451-8a47-cc5a71df992c service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:07.010615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:07.011482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:07.011757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:07.012030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:07.013771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:07.082118 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:07.085312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:07.123125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1137/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:09.685299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:09.686700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:09.713226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:09.745396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052d85-3665-4f20-9a3e-427cf5d02fb8 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:09.748994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:09.753947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:09.753947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:09.753947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:09.753947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:09.765014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:09.766405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08a9c5-6afe-453b-8e22-6363cd21de95 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:09.778437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1160/2297] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:12.430660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:12.492187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8586-2549-49db-8086-ed5cf00f4cee service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:12.497451 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:12.498950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:12.498950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:12.498950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] PATH_INFO: `/v3/users/888acd6e1e644051b1f4ca0c16047fde` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:12.499858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888acd6e1e644051b1f4ca0c16047fde)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:12.501810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:12.661408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888acd6e1e644051b1f4ca0c16047fde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:12.714608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888acd6e1e644051b1f4ca0c16047fde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:12.715215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888acd6e1e644051b1f4ca0c16047fde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:12.715830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888acd6e1e644051b1f4ca0c16047fde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:12.723284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888acd6e1e644051b1f4ca0c16047fde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:12.741890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1138/2298] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:11:12 2022] DELETE /identity/v3/users/888acd6e1e644051b1f4ca0c16047fde => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:11:12.747083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:12.747533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:12.747647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:12.768650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:12.769833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:12.827320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1161/2299] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:12.836889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:12.838455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:12.843843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:12.896689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436131-416e-4f95-b56a-ee736ae00445 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:12.900442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950551a-16a8-4758-bb78-9a25a717c200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:12.901049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950551a-16a8-4758-bb78-9a25a717c200 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:12.901332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950551a-16a8-4758-bb78-9a25a717c200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:12.901608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950551a-16a8-4758-bb78-9a25a717c200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:12.911080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950551a-16a8-4758-bb78-9a25a717c200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:12.912544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950551a-16a8-4758-bb78-9a25a717c200 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:12.922433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1139/2300] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:13.351258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:13.353562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:13.366012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf825a-9b7f-4101-bf3d-162a076b2d0d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:13.370740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:13.371380 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.376444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.376444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] PATH_INFO: `/v3/projects/d8fb1a9447fb4067b1ae5e272ffe6d9e` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.376444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fb1a9447fb4067b1ae5e272ffe6d9e)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:13.376444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:13.470654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fb1a9447fb4067b1ae5e272ffe6d9e', 'request_id': 'req-f4ba0706-c148-4758-9222-bd38f260e328'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:13.476793 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fb1a9447fb4067b1ae5e272ffe6d9e', 'request_id': 'req-f4ba0706-c148-4758-9222-bd38f260e328'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:13.532231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fb1a9447fb4067b1ae5e272ffe6d9e', 'request_id': 'req-f4ba0706-c148-4758-9222-bd38f260e328'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:13.543396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] The token cache is being invalidate because project d8fb1a9447fb4067b1ae5e272ffe6d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:11:13.543682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:13.544295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f4ba0706-c148-4758-9222-bd38f260e328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:13.545796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1162/2301] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:11:13 2022] DELETE /identity/v3/projects/d8fb1a9447fb4067b1ae5e272ffe6d9e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:13.550799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.551284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.551409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.571249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:13.573232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:13.632623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1140/2302] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:13.641000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.641284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.641561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.661650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:13.662882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:13.670941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1163/2303] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:13.675108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:13.684657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af281e1-6b41-4aa9-a8cc-2b01f07b6bf4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:13.689278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:13.689828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.690117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.690395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.691040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:11:13.691345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:13.693026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:13.705080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1141/2304] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:11:13.709170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:13.718822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98aa0ca-850d-4cbd-a583-1026e95859e0 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:13.723511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:13.724049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.724355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.724640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.725262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:13.727418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:13.819404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1164/2305] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:11:13 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:13.824226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:13.834175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887a83-a038-44bd-997a-95b36a328634 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:13.893453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:13.894034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.894311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.894580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.895206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:13.897173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:13.971883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1142/2306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:11:13 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:13.976353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:13.987125 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075c289-f630-49de-8a18-0aa22ff09b02 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:13.991702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:13.992293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:13.992601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:13.992873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:13.994022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:13.995652 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.005315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1165/2307] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:14.010101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.020213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753ca50-0a95-412b-9350-c4462783b90e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.024971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3946e-caed-49bb-a994-7d4e210b83c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.025681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3946e-caed-49bb-a994-7d4e210b83c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.025960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3946e-caed-49bb-a994-7d4e210b83c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.026229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3946e-caed-49bb-a994-7d4e210b83c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.026866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3946e-caed-49bb-a994-7d4e210b83c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.028484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3946e-caed-49bb-a994-7d4e210b83c5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.039238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1143/2308] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:14.043581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.053527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be6d39-57e3-4d70-bfff-43d3967cb3c6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.058716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.059360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.059640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.059919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] PATH_INFO: `/v3/projects/765d29aa241d4ab58cf5d60a1b73e2d1/users/071b99aa24e042cb8f3b6032073cb064/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.062929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:14.075057 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765d29aa241d4ab58cf5d60a1b73e2d1, user_id=071b99aa24e042cb8f3b6032073cb064, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.077720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.155476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1166/2309] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:14 2022] PUT /identity/v3/projects/765d29aa241d4ab58cf5d60a1b73e2d1/users/071b99aa24e042cb8f3b6032073cb064/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:14.166273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.166560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.166840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.187946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:14.195027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] MFA Rules not processed for user `071b99aa24e042cb8f3b6032073cb064`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:14.196247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:14.265736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1144/2310] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:14.270428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.334808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9bc9c-4b40-438e-affe-43a1ba887bc4 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.339682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.340291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.340604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.340881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.341517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.343421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.408406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1167/2311] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:11:14 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:14.411823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.423061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c39112-6113-4b6b-aaf5-6a19482f93fc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.479901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.480462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.480741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.481014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.481638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.483541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.549137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1145/2312] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:11:14 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:14.553133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.563641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362932-61c4-4147-806d-064032c47e53 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.568266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.568906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.569187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.569459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.570090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.572301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.582640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1168/2313] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:14.586718 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.597427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1879d-df23-45b4-ada0-4e7722f894d5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.602472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.603140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.603415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.603710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] PATH_INFO: `/v3/projects/3b157675579e49b39685e45ea9f5c4a2/users/a235988407d047889e4e229ee5d3a1de/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.618997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b157675579e49b39685e45ea9f5c4a2, user_id=a235988407d047889e4e229ee5d3a1de, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.621707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.680506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1146/2314] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:14 2022] PUT /identity/v3/projects/3b157675579e49b39685e45ea9f5c4a2/users/a235988407d047889e4e229ee5d3a1de/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:14.685107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.695098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aebc9-bc7c-4d34-8a26-cc6449c4b796 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.750747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132f94c-651e-4224-abf3-60b3ecd63c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.751255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f94c-651e-4224-abf3-60b3ecd63c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.751530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f94c-651e-4224-abf3-60b3ecd63c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.751801 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f94c-651e-4224-abf3-60b3ecd63c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.752461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132f94c-651e-4224-abf3-60b3ecd63c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.754026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132f94c-651e-4224-abf3-60b3ecd63c6c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.763597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1169/2315] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:14.767774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.778708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e28b8-eda5-4a12-87d9-0622963d0b89 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.783370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.784013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.784292 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.784596 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] PATH_INFO: `/v3/projects/3b157675579e49b39685e45ea9f5c4a2/users/a235988407d047889e4e229ee5d3a1de/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.786475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b157675579e49b39685e45ea9f5c4a2, user_id=a235988407d047889e4e229ee5d3a1de, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.789137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:14.800165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1147/2316] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:14 2022] PUT /identity/v3/projects/3b157675579e49b39685e45ea9f5c4a2/users/a235988407d047889e4e229ee5d3a1de/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:14.811857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.812140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.812446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.839646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] MFA Rules not processed for user `a235988407d047889e4e229ee5d3a1de`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:14.840856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:14.883862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:14.907752 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1170/2317] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:14.920190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:14.921895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:14.979273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeffdf-7de5-4d5e-8008-5621bdf96a48 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:14.982970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:14.983573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:14.983854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:14.984136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:14.991038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:14.993527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:14.994958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:15.006032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1148/2318] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:15.169653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:15.179196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26474f2-9cdb-4336-8918-150c99a892f4 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:15.183446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:15.184037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:15.184333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:15.184616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:15.239536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:15.240977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:15.249827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1171/2319] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:15.463052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:15.467297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:15.520239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394995-581d-45fa-8c63-af6a872002f4 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:15.523696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:15.524293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:15.524624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:15.530352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:15.530352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:15.595532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:15.597036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee288f35-de66-4922-9819-9d38ddb98fb6 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:15.607940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1149/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:21.571024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:21.573428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:21.594108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c579-15c8-4516-941e-82b5aac3c703 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:21.605382 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:21.606417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:21.606417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:21.606655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:21.608398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:21.674716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:21.676298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:21.686259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1172/2321] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:24.068053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:24.068553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:24.068649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:24.088861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:24.090047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:24.148070 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1150/2322] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:24.290571 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:24.293147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:24.371690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6405-838c-44f4-b949-3fee5e47e8cc service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:24.376709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:24.377320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:24.377585 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:24.377855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:24.386109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:24.387655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:24.395762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1173/2323] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:11:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:11:34.140436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=81 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:34.392647 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:36.697587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:36.699245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:36.710936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d037649-a5ee-4aea-a850-9be64f165bc1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:36.714790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:36.715402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:36.715683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:36.715957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:36.717733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:36.728270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:36.730377 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:36.739121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1151/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:42.378138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:42.390978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7bf71-250f-4855-ad1c-8cef413b0abc service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:42.397421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:42.398921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:42.399458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:42.400064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:42.404181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:42.416631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:42.418548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8771c-fff4-4809-ade5-004cad496762 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:42.430769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1174/2325] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:43.373445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:43.383176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77296e2f-6452-4b6f-aa63-f21d2b347bf5 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:43.388497 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:43.392302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:43.392302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:43.392302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:43.392302 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:43.404057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:43.406229 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f468559-8f45-48dc-9fcd-5529502af39c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:43.429199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1152/2326] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:43.835172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d5dd-1a9d-4f14-8d74-853ccc0f7b18 None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:43.835737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d5dd-1a9d-4f14-8d74-853ccc0f7b18 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:43.835737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218d5dd-1a9d-4f14-8d74-853ccc0f7b18 None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:43.837096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1175/2327] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:11:43.844116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd790587-fcea-4998-8d88-9bfb636f25f2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:43.844518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd790587-fcea-4998-8d88-9bfb636f25f2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:43.844685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd790587-fcea-4998-8d88-9bfb636f25f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:43.867096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bd790587-fcea-4998-8d88-9bfb636f25f2 None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:43.868568 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd790587-fcea-4998-8d88-9bfb636f25f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:43.878009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1153/2328] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:43.890198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d5dd-1a9d-4f14-8d74-853ccc0f7b18 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:43.892119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2218d5dd-1a9d-4f14-8d74-853ccc0f7b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:43.969872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218d5dd-1a9d-4f14-8d74-853ccc0f7b18 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:43.973386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ec89e-2d28-46ad-885d-ee33a2f92e1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:43.973983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec89e-2d28-46ad-885d-ee33a2f92e1b service glance] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:43.974259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec89e-2d28-46ad-885d-ee33a2f92e1b service glance] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:43.974528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec89e-2d28-46ad-885d-ee33a2f92e1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:43.984897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ec89e-2d28-46ad-885d-ee33a2f92e1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:43.986387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ec89e-2d28-46ad-885d-ee33a2f92e1b service glance] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:43.997447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1176/2329] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:44.183779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64cc69-d5c1-4502-9eb5-e424834df28c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.184058 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64cc69-d5c1-4502-9eb5-e424834df28c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.184366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64cc69-d5c1-4502-9eb5-e424834df28c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.185713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1154/2330] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:11:44.190576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562967-154f-43bb-92f2-8087b1174b3d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.190863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562967-154f-43bb-92f2-8087b1174b3d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.191141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562967-154f-43bb-92f2-8087b1174b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.211658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f9562967-154f-43bb-92f2-8087b1174b3d None None] MFA Rules not processed for user `f259e1d9dd2d47e4af4d4dcdc93eaef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:44.212939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f9562967-154f-43bb-92f2-8087b1174b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:44.220184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1177/2331] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:44.232065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64cc69-d5c1-4502-9eb5-e424834df28c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:44.242762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64cc69-d5c1-4502-9eb5-e424834df28c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:44.246994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132d676-d1f8-448c-93bf-261d0152697a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:44.247633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132d676-d1f8-448c-93bf-261d0152697a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.248074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132d676-d1f8-448c-93bf-261d0152697a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.248431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132d676-d1f8-448c-93bf-261d0152697a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.255623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132d676-d1f8-448c-93bf-261d0152697a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:44.257153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132d676-d1f8-448c-93bf-261d0152697a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:44.267650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1155/2332] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:44.351137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015b2d-f4a1-4946-b4e9-92491fa22b9f None None] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.351686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015b2d-f4a1-4946-b4e9-92491fa22b9f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.352033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015b2d-f4a1-4946-b4e9-92491fa22b9f None None] PATH_INFO: `/` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.353424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1178/2333] 10.222.0.26 () {54 vars in 921 bytes} [Thu Sep 15 11:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 11:11:44.358749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.359028 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.359298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.383754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] MFA Rules not processed for user `3c2b03530d554c27b1dc3282a5063df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:44.384975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:44.396335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1156/2334] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Sep 15 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:44.408427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015b2d-f4a1-4946-b4e9-92491fa22b9f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:44.422093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015b2d-f4a1-4946-b4e9-92491fa22b9f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:44.425635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e101-c17c-4a1c-8c1e-cfcbfb668dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:44.426294 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e101-c17c-4a1c-8c1e-cfcbfb668dca service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.426571 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e101-c17c-4a1c-8c1e-cfcbfb668dca service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.426839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e101-c17c-4a1c-8c1e-cfcbfb668dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.437581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e101-c17c-4a1c-8c1e-cfcbfb668dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:44.439171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e101-c17c-4a1c-8c1e-cfcbfb668dca service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:44.450343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1179/2335] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:11:44.514740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:44.519075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:44.585629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a89774-19e1-4f8b-99be-7de9c00deb04 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:44.591235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:44.591840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:44.592120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:44.592429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:44.594143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:44.606721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:44.610913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:44.619472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1157/2336] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:47.031279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:47.031804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:47.031804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:47.053965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:47.055244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:47.063890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1180/2337] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:47.076774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:47.087585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad71db4-d395-4997-ae53-4d78d7350938 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:47.093175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:47.093774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:47.094106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:47.094387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:47.102708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:47.104272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:47.113168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1158/2338] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:11:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 11:11:49.442477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:49.452899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac5d58-861b-4954-836e-367a9a3baf6b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:49.456600 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:49.457278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:49.457624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:49.457962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:49.459864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:49.537044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:49.538446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edee37-9612-4df6-8525-624820b8c941 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:49.549362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1181/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:53.147687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:53.160846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e206a-2c71-4aba-aca3-14be1f54fa93 service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:53.170054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:53.171135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:53.171422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:53.171699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] PATH_INFO: `/v3/users/071b99aa24e042cb8f3b6032073cb064` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:53.172899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071b99aa24e042cb8f3b6032073cb064)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:53.175173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:53.413804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071b99aa24e042cb8f3b6032073cb064'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:53.479623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071b99aa24e042cb8f3b6032073cb064'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:53.480731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071b99aa24e042cb8f3b6032073cb064'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:53.482306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071b99aa24e042cb8f3b6032073cb064'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:53.493208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071b99aa24e042cb8f3b6032073cb064'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:53.508661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:53.544597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1159/2340] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:11:53 2022] DELETE /identity/v3/users/071b99aa24e042cb8f3b6032073cb064 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:53.547461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:53.547999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:53.548172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:53.585713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:53.587727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:53.727292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:53.739685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1182/2341] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:53.750066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:53.751892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:53.851584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072fa64-a5b7-49bd-ba03-044e2ee63046 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:53.857126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:53.858241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:53.858680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:53.859082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:53.888559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:53.891716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:53.913409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1160/2342] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:55.859122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:55.859122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:55.864740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:55.866957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:55.881910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be8fe8-b4af-4334-b213-6990a97e0424 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:55.887869 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4961e-51a6-4b6c-8603-6d7f28d560e7 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:55.895477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:55.896772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:55.897546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:55.898137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] PATH_INFO: `/v3/users/0ea736407a9846e9899e10a8320e692a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:55.900455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea736407a9846e9899e10a8320e692a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:55.904435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:55.904435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:55.904435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:55.905817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] PATH_INFO: `/v3/projects/765d29aa241d4ab58cf5d60a1b73e2d1` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:55.907158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:55.907973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=765d29aa241d4ab58cf5d60a1b73e2d1)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:55.915717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:56.829938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea736407a9846e9899e10a8320e692a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.832200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765d29aa241d4ab58cf5d60a1b73e2d1', 'request_id': 'req-24d20d24-df7e-452b-ae9c-c4269c211f7d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.838979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765d29aa241d4ab58cf5d60a1b73e2d1', 'request_id': 'req-24d20d24-df7e-452b-ae9c-c4269c211f7d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.879573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea736407a9846e9899e10a8320e692a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.880286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea736407a9846e9899e10a8320e692a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.881076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea736407a9846e9899e10a8320e692a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.889043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea736407a9846e9899e10a8320e692a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.907677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1161/2343] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:11:55 2022] DELETE /identity/v3/users/0ea736407a9846e9899e10a8320e692a => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:56.929431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765d29aa241d4ab58cf5d60a1b73e2d1', 'request_id': 'req-24d20d24-df7e-452b-ae9c-c4269c211f7d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.942286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] The token cache is being invalidate because project 765d29aa241d4ab58cf5d60a1b73e2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:11:56.942589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.943232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:56.944765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1183/2344] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:11:55 2022] DELETE /identity/v3/projects/765d29aa241d4ab58cf5d60a1b73e2d1 => generated 0 bytes in 1097 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:56.948754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:56.950262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:57.023039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90002497-ec29-4a45-83f2-c55b7f336b25 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:57.033438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:57.034101 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.034387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.034652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] PATH_INFO: `/v3/users/a235988407d047889e4e229ee5d3a1de` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.035818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a235988407d047889e4e229ee5d3a1de)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:57.038112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:57.052434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:57.238010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:57.239477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:57.278363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a235988407d047889e4e229ee5d3a1de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.320277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d20d24-df7e-452b-ae9c-c4269c211f7d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:57.324864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:57.325527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.325809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.326084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] PATH_INFO: `/v3/projects/10b367182e084780a3349c99b5a7787b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.327786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b367182e084780a3349c99b5a7787b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:57.329745 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:57.387332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a235988407d047889e4e229ee5d3a1de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.387951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a235988407d047889e4e229ee5d3a1de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.388576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a235988407d047889e4e229ee5d3a1de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.396722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c7955624-ffdc-401b-953d-310548019981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a235988407d047889e4e229ee5d3a1de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.414717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1162/2345] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:11:56 2022] DELETE /identity/v3/users/a235988407d047889e4e229ee5d3a1de => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:11:57.470493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b367182e084780a3349c99b5a7787b', 'request_id': 'req-0f8e73d8-1787-4995-8c38-4f18593cbaa3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.477113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b367182e084780a3349c99b5a7787b', 'request_id': 'req-0f8e73d8-1787-4995-8c38-4f18593cbaa3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.548144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b367182e084780a3349c99b5a7787b', 'request_id': 'req-0f8e73d8-1787-4995-8c38-4f18593cbaa3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.560025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] The token cache is being invalidate because project 10b367182e084780a3349c99b5a7787b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:11:57.560473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.561113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0f8e73d8-1787-4995-8c38-4f18593cbaa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.563680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1184/2346] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:11:57 2022] DELETE /identity/v3/projects/10b367182e084780a3349c99b5a7787b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:11:57.568446 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.571188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.571188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.589322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:57.599208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:57.654969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1163/2347] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:11:57.664561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.667910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.667910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.686589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:57.687718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:57.695909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1185/2348] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:57.700136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:57.710063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ac2c6-3f69-44c9-998c-59bf5faf7689 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:57.714551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:57.715154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.715433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.715711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.716383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:11:57.716694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:57.718893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:57.731219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1164/2349] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:11:57.736282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:57.741816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:57.745483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2527-b211-48bd-9c4b-93813fdecd24 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:57.750188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:57.750776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.751051 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.751322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.751989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:57.753894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:57.806484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:57.808561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:57.822410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ab911-cd93-475d-8e55-5a9a6835e252 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:57.829264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:57.832963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.832963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.832963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] PATH_INFO: `/v3/projects/3b157675579e49b39685e45ea9f5c4a2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.833730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1186/2350] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:11:57 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:11:57.834001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b157675579e49b39685e45ea9f5c4a2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:57.835043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:57.836374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:57.898282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3e312-b01d-4f60-aa9b-848367ec77ef admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:57.902941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:57.903535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:57.903809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:57.904079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:57.904744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:57.907478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:57.942284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b157675579e49b39685e45ea9f5c4a2', 'request_id': 'req-fc1a2705-400f-41fe-ab18-8d248889c4d4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:57.948907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b157675579e49b39685e45ea9f5c4a2', 'request_id': 'req-fc1a2705-400f-41fe-ab18-8d248889c4d4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:58.004202 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1187/2351] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:11:57 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:58.008260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.018616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa773-d82f-4f98-9f68-944ce3c34f12 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.026193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b157675579e49b39685e45ea9f5c4a2', 'request_id': 'req-fc1a2705-400f-41fe-ab18-8d248889c4d4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:58.039387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] The token cache is being invalidate because project 3b157675579e49b39685e45ea9f5c4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:11:58.039535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:58.040119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc1a2705-400f-41fe-ab18-8d248889c4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:58.041654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1165/2352] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:11:57 2022] DELETE /identity/v3/projects/3b157675579e49b39685e45ea9f5c4a2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:11:58.046583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398da9-4c65-4c95-b9b0-3822ed996600 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.046868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398da9-4c65-4c95-b9b0-3822ed996600 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.047148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398da9-4c65-4c95-b9b0-3822ed996600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.068204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-67398da9-4c65-4c95-b9b0-3822ed996600 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:58.069373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-67398da9-4c65-4c95-b9b0-3822ed996600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:58.077735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.078514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.078791 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.079070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.079768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.081400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.096188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1188/2353] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:11:58.097271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.099742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:58.113083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07228b61-dc55-45e2-81b0-837d265bfa11 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.120288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.120929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.121276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.121550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.122183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.123818 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.136646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1189/2354] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:58.141356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.144294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1166/2355] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:11:58.151174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765698ce-82d1-4955-8478-0639a6d6111a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.151700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.151962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.152236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.158743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc17f-25bd-4a8a-946f-f97974a44cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.159434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc17f-25bd-4a8a-946f-f97974a44cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.159706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc17f-25bd-4a8a-946f-f97974a44cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.159978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc17f-25bd-4a8a-946f-f97974a44cc8 admin admin] PATH_INFO: `/v3/projects/26137fbfa8064f6d8a8d540e09e199a1/users/9e440eff27a9452d99baa783406c76d7/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.172734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:58.173922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:58.174688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc17f-25bd-4a8a-946f-f97974a44cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26137fbfa8064f6d8a8d540e09e199a1, user_id=9e440eff27a9452d99baa783406c76d7, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.177332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc17f-25bd-4a8a-946f-f97974a44cc8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.182846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1167/2356] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:11:58.187175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.197014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254274ec-f1ed-4330-b653-d485799ca6c0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.202966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.203645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.203921 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.204191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.204867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:11:58.205181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.206846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.220965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1168/2357] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:11:58.225338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.235190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148274b4-6a36-4e50-b3b7-087495404a17 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.239798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.240408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.240683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.240951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.241562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.243506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.261196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1190/2358] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:58 2022] PUT /identity/v3/projects/26137fbfa8064f6d8a8d540e09e199a1/users/9e440eff27a9452d99baa783406c76d7/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:11:58.273494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.273887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.274176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.303630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] MFA Rules not processed for user `9e440eff27a9452d99baa783406c76d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:58.304925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:58.353283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1169/2359] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:11:58.354448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.376177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1191/2360] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:11:58.386493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.390618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:58.390853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:58.432485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5fc1-fa36-4607-8dfe-87b2f39d47c9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.438276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.442782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.442782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.442782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.442782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.442782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.472883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2958625-cdf4-4bf8-8dda-2ffb52763766 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.521361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1170/2361] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:58.525144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.535407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761197e-0487-41cc-9606-55c6baa306a2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.540228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.540857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.541137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.541417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.541789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334b2d3-2dbc-4183-ad9d-1aa29faab1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.542053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.542424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334b2d3-2dbc-4183-ad9d-1aa29faab1e0 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.542704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334b2d3-2dbc-4183-ad9d-1aa29faab1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.542976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334b2d3-2dbc-4183-ad9d-1aa29faab1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.543636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.554113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1171/2362] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:58.557879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.568438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e843a5d-4ee4-4419-9d91-470e0bbd2868 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.573136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.574042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.574042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.574271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.574937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.576551 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.587993 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1172/2363] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:11:58.591994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.600847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334b2d3-2dbc-4183-ad9d-1aa29faab1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.602517 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc222931-6710-4821-ae5f-4c2d0c0490b5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.602832 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334b2d3-2dbc-4183-ad9d-1aa29faab1e0 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.608161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.609087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.609431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.609743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] PATH_INFO: `/v3/projects/566c97109c8645f4bb045fd90337875b/users/1e08de9b478944769299e021aa83cf04/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.613019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1192/2364] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:11:58.626599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] RBAC: Authorizing `identity:create_grant(project_id=566c97109c8645f4bb045fd90337875b, user_id=1e08de9b478944769299e021aa83cf04, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.631395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.707330 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1173/2365] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:58 2022] PUT /identity/v3/projects/566c97109c8645f4bb045fd90337875b/users/1e08de9b478944769299e021aa83cf04/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:11:58.720244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.720582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.720863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.733584 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:58.757709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] MFA Rules not processed for user `1e08de9b478944769299e021aa83cf04`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:58.759673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:58.848712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1193/2366] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:58.850165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.853236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:58.922371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c50b-2247-4913-bf64-704264c9670a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.924148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a351c05-ca91-441a-b8d5-10ceb7e9dcba None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:58.927656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.928426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.928859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.929196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] PATH_INFO: `/v3/users/9e440eff27a9452d99baa783406c76d7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.929946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:58.930309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e440eff27a9452d99baa783406c76d7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.930741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:58.931071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:58.931412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:58.932164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:58.932588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:58.934370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.000594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:59.047994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:59.055711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1194/2367] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:11:58 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:11:59.060030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.116522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e440eff27a9452d99baa783406c76d7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:59.127587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92532a3f-9784-4252-bb86-6352ad750d5a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.132371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.132975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.133255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.133531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.134158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.136061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.210730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e440eff27a9452d99baa783406c76d7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:59.211374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e440eff27a9452d99baa783406c76d7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:59.212611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e440eff27a9452d99baa783406c76d7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:59.236343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1195/2368] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:11:59 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:11:59.238180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.239886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ba8c37d3-3760-41f2-b2f6-b7fbdd266556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e440eff27a9452d99baa783406c76d7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:11:59.241108 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:59.250704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:59.259527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4bf0-fea2-4498-84b7-c659dadb8c62 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.268298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.269105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.269520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.269917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.270881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.273959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.278800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1174/2369] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:11:58 2022] DELETE /identity/v3/users/9e440eff27a9452d99baa783406c76d7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:59.284771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.285677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.285677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.289634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1196/2370] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:11:59.294703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.310035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcce47d-8ec9-438e-aea6-e6efc49cda24 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.329797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:59.331124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:59.387692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.388353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.388618 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.388900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] PATH_INFO: `/v3/projects/41a41e0700ce484b962b67557c4db091/users/60f6a1a8d42b4abe8ff7a716fce11ca9/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.403334 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1175/2371] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:59.407293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a41e0700ce484b962b67557c4db091, user_id=60f6a1a8d42b4abe8ff7a716fce11ca9, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.408922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.413062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.414423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:59.440548 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:59.471810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddfc69-45b9-47d9-95c6-b6b0e8e89255 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.475460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.476362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.476643 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.476925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.485511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1197/2372] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:59 2022] PUT /identity/v3/projects/41a41e0700ce484b962b67557c4db091/users/60f6a1a8d42b4abe8ff7a716fce11ca9/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:59.487331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.488915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.490119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.500794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1176/2373] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:11:59.568830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802fa3b-03e1-4827-8e4d-a4c52b0fe0c3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.574375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54ec4-4795-421b-b156-fb5ce6e55f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.575261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54ec4-4795-421b-b156-fb5ce6e55f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.575763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54ec4-4795-421b-b156-fb5ce6e55f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.576141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54ec4-4795-421b-b156-fb5ce6e55f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.576684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54ec4-4795-421b-b156-fb5ce6e55f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.579101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54ec4-4795-421b-b156-fb5ce6e55f89 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.589873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1198/2374] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:11:59.595510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.609335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5cfd9-89e1-432a-8d4a-340ed2587cde service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.618125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.618896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.619293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.619635 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] PATH_INFO: `/v3/projects/41a41e0700ce484b962b67557c4db091/users/60f6a1a8d42b4abe8ff7a716fce11ca9/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.621745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a41e0700ce484b962b67557c4db091, user_id=60f6a1a8d42b4abe8ff7a716fce11ca9, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.625857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.635881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1177/2375] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:11:59 2022] PUT /identity/v3/projects/41a41e0700ce484b962b67557c4db091/users/60f6a1a8d42b4abe8ff7a716fce11ca9/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:11:59.646800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.647022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.647299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.677152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] MFA Rules not processed for user `60f6a1a8d42b4abe8ff7a716fce11ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:11:59.678398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:59.757325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:11:59.768169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1199/2376] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:11:59.779971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.782406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:11:59.862863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70d94-9bf6-4f7e-adc7-81efcc113e12 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:11:59.866579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2813-51bc-4947-97ce-96c16ad26fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:11:59.867838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2813-51bc-4947-97ce-96c16ad26fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:11:59.868122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2813-51bc-4947-97ce-96c16ad26fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:11:59.868483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2813-51bc-4947-97ce-96c16ad26fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:11:59.878997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f2813-51bc-4947-97ce-96c16ad26fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:11:59.880465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f2813-51bc-4947-97ce-96c16ad26fe5 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:11:59.889942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1178/2377] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:11:59.936386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:11:59.937891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:00.003412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da7bb8-993c-4354-b693-fe0ad97d4496 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.007921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.008576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.008910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.009190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] PATH_INFO: `/v3/projects/26137fbfa8064f6d8a8d540e09e199a1` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.010293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=26137fbfa8064f6d8a8d540e09e199a1)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.012236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.125929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26137fbfa8064f6d8a8d540e09e199a1', 'request_id': 'req-f53a521c-5dde-41f4-b8ef-87398fa207cf'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:00.132088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26137fbfa8064f6d8a8d540e09e199a1', 'request_id': 'req-f53a521c-5dde-41f4-b8ef-87398fa207cf'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:00.214864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26137fbfa8064f6d8a8d540e09e199a1', 'request_id': 'req-f53a521c-5dde-41f4-b8ef-87398fa207cf'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:00.226254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] The token cache is being invalidate because project 26137fbfa8064f6d8a8d540e09e199a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:00.226545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:00.227184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f53a521c-5dde-41f4-b8ef-87398fa207cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:00.228798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1200/2378] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:11:59 2022] DELETE /identity/v3/projects/26137fbfa8064f6d8a8d540e09e199a1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:00.233656 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.234151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.234275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.253744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:00.254975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:00.319136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1179/2379] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:00.326456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.326761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.328330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.352462 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:00.353870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:00.362768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1201/2380] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:00.367107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.377927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a191c-e956-4039-9058-df8d79b73902 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.382499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.383099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.383411 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.383686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.384356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:00.384663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.386244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.399653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1180/2381] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:00.404551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.424249 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd6d6-da4f-45ca-9f35-cf6f4601a24e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.430881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.434511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.434511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.434511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.434511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.437164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.542098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1202/2382] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:00 2022] POST /identity/v3/projects => generated 355 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:00.549390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.559469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125352a8-7494-4aed-94f8-be7d4865eb60 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.609372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:00.626672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.627299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.627583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.627863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.628528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.630459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.745263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1181/2383] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:00 2022] POST /identity/v3/users => generated 278 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:00.746562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.759708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0636c-4ee8-4f8a-a435-6347316a0979 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.766876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.767506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.767988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.768383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.768956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.770609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.781547 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1203/2384] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:00.785479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.795948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe025d0-6781-4a5c-b01d-21a3dc760b6b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.800988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.801593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.801876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.802154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.802807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.804435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.819486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1182/2385] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:00.820728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.838951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6846f2-f2af-4c5e-b50f-c6935ec1531a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.843748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b005f-231f-47da-b9fe-08e4c8222c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.853519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b005f-231f-47da-b9fe-08e4c8222c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.853809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b005f-231f-47da-b9fe-08e4c8222c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.854094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b005f-231f-47da-b9fe-08e4c8222c0e admin admin] PATH_INFO: `/v3/projects/e6d059495a174851bda15d4e9467c083/users/453f1d7b9726412e91112dcc59f51bdd/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.863569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:00.865584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:00.880543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2f05-d1db-4f65-b880-17d923cac3ad admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:00.887212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:00.887815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:00.888099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:00.888409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] PATH_INFO: `/v3/users/1e08de9b478944769299e021aa83cf04` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:00.890572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e08de9b478944769299e021aa83cf04)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.892359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b005f-231f-47da-b9fe-08e4c8222c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d059495a174851bda15d4e9467c083, user_id=453f1d7b9726412e91112dcc59f51bdd, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:00.897297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.897435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b005f-231f-47da-b9fe-08e4c8222c0e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:00.992529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1204/2386] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:00 2022] PUT /identity/v3/projects/e6d059495a174851bda15d4e9467c083/users/453f1d7b9726412e91112dcc59f51bdd/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:01.003989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.004280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.004590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.047012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] MFA Rules not processed for user `453f1d7b9726412e91112dcc59f51bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:01.048756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:01.059891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:01.126819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e08de9b478944769299e021aa83cf04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:01.127040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1205/2387] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:01.131291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.181416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e08de9b478944769299e021aa83cf04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:01.182041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e08de9b478944769299e021aa83cf04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:01.182651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e08de9b478944769299e021aa83cf04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:01.194202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8dac5b8-7e22-473a-8cfa-9d236c56413a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e08de9b478944769299e021aa83cf04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:01.215123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddf80-c0f7-4d8d-96f5-c1ab09569aef None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.219621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1183/2388] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:00 2022] DELETE /identity/v3/users/1e08de9b478944769299e021aa83cf04 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:01.224080 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.224487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.224774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.225610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.228014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.228014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.228014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.228014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.229915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.250634 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:01.252455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:01.329783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1206/2389] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:01 2022] POST /identity/v3/projects => generated 357 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:01.334902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.336351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1184/2390] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:01.336863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:01.348687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.350375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:01.403434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:01.428722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891260-706d-45e7-b374-ae33c8ff534d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.433765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.434586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.435119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.435650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.436834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.439219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.442144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9b614-9436-4372-8414-5adb9d7aecc7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.500476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.501441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.501664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.501942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.512137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.513607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.525068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1185/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:01.525906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.527842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:01.546170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1207/2392] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:01 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:01.550228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.564781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1261e9-6ddb-41f1-b86a-b3985b163d03 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.571675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.572538 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.572825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.573110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.573762 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.575491 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.590211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1208/2393] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:01.595952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.607519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4462fd8-3c4f-4a7b-92b0-5a4c6d948e7c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.612863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.615435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.615435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.615435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] PATH_INFO: `/v3/projects/6f992d181258480c99244aa6a4f9ecca/users/e8b4339884b04522b587c0240b98fb54/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.632396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:01.636384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f992d181258480c99244aa6a4f9ecca, user_id=e8b4339884b04522b587c0240b98fb54, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.641361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c97071-4f75-446e-a504-db1da4e43a01 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.647097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.648029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.648927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.649283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.649669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.651680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:01.665245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.666969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.678959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1186/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:01.739728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1209/2395] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:01 2022] PUT /identity/v3/projects/6f992d181258480c99244aa6a4f9ecca/users/e8b4339884b04522b587c0240b98fb54/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:01.746142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.758933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb939b9b-f790-42c5-941f-12057c38125d service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.860569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d7c5f-30f3-4882-b7cc-c7bd996edd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.861130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7c5f-30f3-4882-b7cc-c7bd996edd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.861489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7c5f-30f3-4882-b7cc-c7bd996edd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.861822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d7c5f-30f3-4882-b7cc-c7bd996edd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.862492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d7c5f-30f3-4882-b7cc-c7bd996edd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.864254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d7c5f-30f3-4882-b7cc-c7bd996edd64 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.879888 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:01.880924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1187/2396] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:01.890847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6c3eb-1098-4826-9b06-c6127757c774 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:01.896706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:01.897967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.898695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.899348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] PATH_INFO: `/v3/projects/6f992d181258480c99244aa6a4f9ecca/users/e8b4339884b04522b587c0240b98fb54/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.902783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f992d181258480c99244aa6a4f9ecca, user_id=e8b4339884b04522b587c0240b98fb54, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:01.909880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:01.931248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1210/2397] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:01 2022] PUT /identity/v3/projects/6f992d181258480c99244aa6a4f9ecca/users/e8b4339884b04522b587c0240b98fb54/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:01.948708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:01.949253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:01.949969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:01.994030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:02.005901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] MFA Rules not processed for user `e8b4339884b04522b587c0240b98fb54`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:02.007925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:02.080555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:02.086634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:02.161163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1188/2398] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:02.174447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:02.179475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:02.206831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8fa8c-104f-455e-8811-bb98ffc9e48a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:02.211703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:02.212360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:02.212646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:02.212924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] PATH_INFO: `/v3/projects/566c97109c8645f4bb045fd90337875b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:02.214164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566c97109c8645f4bb045fd90337875b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:02.216132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:02.240174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c0ab0-7eb5-44db-a860-753aeae2a751 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:02.244126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:02.244778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:02.245060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:02.248106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:02.255210 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:02.256715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:02.267332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1189/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:02.348922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566c97109c8645f4bb045fd90337875b', 'request_id': 'req-7d09785e-e450-40e5-aeef-e1c4366e6d87'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.355675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566c97109c8645f4bb045fd90337875b', 'request_id': 'req-7d09785e-e450-40e5-aeef-e1c4366e6d87'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.444334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566c97109c8645f4bb045fd90337875b', 'request_id': 'req-7d09785e-e450-40e5-aeef-e1c4366e6d87'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.456094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] The token cache is being invalidate because project 566c97109c8645f4bb045fd90337875b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:02.456438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.457083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.458559 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1211/2400] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:02 2022] DELETE /identity/v3/projects/566c97109c8645f4bb045fd90337875b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:02.462622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:02.474182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d7c9a-07f9-42cc-b5ef-b8cf8f1cded9 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:02.504619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:02.506695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:02.552172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:02.553640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:02.553996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:02.554444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] PATH_INFO: `/v3/users/60f6a1a8d42b4abe8ff7a716fce11ca9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:02.555693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f6a1a8d42b4abe8ff7a716fce11ca9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:02.558247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:02.577924 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09785e-e450-40e5-aeef-e1c4366e6d87 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:02.582533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:02.583147 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:02.583429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:02.583706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:02.589110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:02.613794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:02.658241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:02.659709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:02.668569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1212/2401] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:02.741691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:02.744282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f6a1a8d42b4abe8ff7a716fce11ca9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.809185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f6a1a8d42b4abe8ff7a716fce11ca9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.810152 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f6a1a8d42b4abe8ff7a716fce11ca9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.810764 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f6a1a8d42b4abe8ff7a716fce11ca9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.818698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e5978e0-0a6d-4e19-9e09-2189a966d019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f6a1a8d42b4abe8ff7a716fce11ca9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:02.835736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1190/2402] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:02 2022] DELETE /identity/v3/users/60f6a1a8d42b4abe8ff7a716fce11ca9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:03.367681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:03.370302 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:03.385169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103b4b2-9d4b-4470-aaba-ad5e3e929fc3 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:03.443260 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:03.443891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:03.444164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:03.444470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] PATH_INFO: `/v3/projects/41a41e0700ce484b962b67557c4db091` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:03.445576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a41e0700ce484b962b67557c4db091)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:03.449526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:03.546849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a41e0700ce484b962b67557c4db091', 'request_id': 'req-399a516d-a820-4488-ae86-f3ece6c3f96c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:03.552804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a41e0700ce484b962b67557c4db091', 'request_id': 'req-399a516d-a820-4488-ae86-f3ece6c3f96c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:03.610065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a41e0700ce484b962b67557c4db091', 'request_id': 'req-399a516d-a820-4488-ae86-f3ece6c3f96c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:03.620891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] The token cache is being invalidate because project 41a41e0700ce484b962b67557c4db091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:03.621188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:03.621824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-399a516d-a820-4488-ae86-f3ece6c3f96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:03.623319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1213/2403] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:03 2022] DELETE /identity/v3/projects/41a41e0700ce484b962b67557c4db091 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:03.629527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:03.630094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:03.630094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:03.662895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:03.662895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:03.714204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1191/2404] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:03.724069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:03.724402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:03.724683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:03.745310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:03.746578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:03.755080 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1214/2405] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:03.759296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:03.769393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b483c-533b-4faf-8279-bb4a9a8264ff None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:03.774112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:03.774879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:03.775166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:03.775442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:03.776099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:03.776456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:03.778062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:03.790953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1192/2406] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:03.795107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:03.805649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114c45-3bb8-4070-9da6-18306f6a8ed6 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:03.810357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:03.810998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:03.811289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:03.811564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:03.812195 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:03.814176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:03.902497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1215/2407] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:03 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:03.907151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:03.917225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda47d6-a134-4908-9449-8d0ea5824082 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:03.973953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:03.974556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:03.974838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:03.975115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:03.975753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:03.978030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.074183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1193/2408] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:03 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:04.078049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.089243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1362e2f-5058-4f49-90fe-90c768c4dc8c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.094757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.095350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.095627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.095898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.096567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.098155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.109226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1216/2409] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:04.113350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.123316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b38520-8787-4a66-93af-3d09ac2bbb57 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.128506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540a65-4171-4470-bbec-bda84522cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.129094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540a65-4171-4470-bbec-bda84522cf19 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.129373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540a65-4171-4470-bbec-bda84522cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.129653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540a65-4171-4470-bbec-bda84522cf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.130283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540a65-4171-4470-bbec-bda84522cf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.131856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540a65-4171-4470-bbec-bda84522cf19 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.142206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1194/2410] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:04.146209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.156104 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d4517-51d2-4f1a-bac3-7a92de64874d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.160643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.161289 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.161568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.161842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] PATH_INFO: `/v3/projects/c5182198483c4092b909df2f476de217/users/c49b1f19ae20433b9a88476aaec23882/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.173469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:04.177326 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5182198483c4092b909df2f476de217, user_id=c49b1f19ae20433b9a88476aaec23882, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.180270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.256219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1217/2411] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:04 2022] PUT /identity/v3/projects/c5182198483c4092b909df2f476de217/users/c49b1f19ae20433b9a88476aaec23882/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:04.266576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.266863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.267138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.294663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] MFA Rules not processed for user `c49b1f19ae20433b9a88476aaec23882`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:04.296480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:04.308861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:04.361744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1195/2412] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:04.366420 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.435010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef47cf-d341-4207-bae0-1173a8651253 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.439097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.439695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.439971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.440246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.441127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.443005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.562988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1218/2413] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:04 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:04.565514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.577706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a6f1-3126-442b-87b8-a58e13753eb7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.638153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.640089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.640405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.640687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.641324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.643310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.746925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1196/2414] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:04 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:04.751215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.761806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b4af-8787-4ee3-b8e5-311b929a068d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.767099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993c029-76dd-4e2c-80f7-b69086a88873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.767692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993c029-76dd-4e2c-80f7-b69086a88873 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.767969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993c029-76dd-4e2c-80f7-b69086a88873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.768243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993c029-76dd-4e2c-80f7-b69086a88873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.769045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993c029-76dd-4e2c-80f7-b69086a88873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.770649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993c029-76dd-4e2c-80f7-b69086a88873 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.781946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1219/2415] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:04.786135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.797461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976780-fc36-463a-a6ad-d06fe9fc68d3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:04.804071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:04.807086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.811593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.811593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.811780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:04.811780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:04.811780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] PATH_INFO: `/v3/projects/ddc19e665cec4acdb7f144dbc7d278dd/users/f498a8ea7a0246669d25d0244012e6af/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:04.827950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc19e665cec4acdb7f144dbc7d278dd, user_id=f498a8ea7a0246669d25d0244012e6af, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:04.829630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:04.830862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:04.831000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:04.895515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1220/2416] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 15 11:12:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:04.911595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:04.915008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:04.934136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1197/2417] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:04 2022] PUT /identity/v3/projects/ddc19e665cec4acdb7f144dbc7d278dd/users/f498a8ea7a0246669d25d0244012e6af/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:04.939423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:05.004969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901365-1a5c-4527-92b1-9e7a4062fe7f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:05.015709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:05.068141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1927-21a8-4fc7-94c2-a09229028838 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:05.068141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:05.068141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:05.068141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:05.068569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:05.068569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:05.068569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:05.075863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1198/2418] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:05.080529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:05.090957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edcacd-4917-4e25-b08d-eb5d758b1073 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:05.095975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:05.096704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:05.096944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0ad0-ba11-4725-9b2d-60502b26d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:05.097066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:05.097246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:05.098002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0ad0-ba11-4725-9b2d-60502b26d5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:05.098373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0ad0-ba11-4725-9b2d-60502b26d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:05.098739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0ad0-ba11-4725-9b2d-60502b26d5db admin admin] PATH_INFO: `/v3/projects/ddc19e665cec4acdb7f144dbc7d278dd/users/f498a8ea7a0246669d25d0244012e6af/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:05.101165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0ad0-ba11-4725-9b2d-60502b26d5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc19e665cec4acdb7f144dbc7d278dd, user_id=f498a8ea7a0246669d25d0244012e6af, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:05.104096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0ad0-ba11-4725-9b2d-60502b26d5db admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:05.116720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1199/2419] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:05 2022] PUT /identity/v3/projects/ddc19e665cec4acdb7f144dbc7d278dd/users/f498a8ea7a0246669d25d0244012e6af/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:05.127679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:05.127969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:05.128250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:05.139654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:05.160091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:05.161871 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] MFA Rules not processed for user `f498a8ea7a0246669d25d0244012e6af`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:05.162072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:05.163750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:05.170988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1221/2420] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:12:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 11:12:05.249140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1200/2421] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:05.260608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:05.261930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:05.337027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8d844-b696-408f-9a3c-c1765bc7fbdc service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:05.397393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:05.397393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:05.397662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:05.398012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:05.412024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:05.413691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:05.424734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1222/2422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:05.564037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:05.573833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525459d-3080-44de-a4e4-5e46536cf163 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:05.578246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af365-bab8-43e2-a1b0-1f96b618a7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:05.579082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af365-bab8-43e2-a1b0-1f96b618a7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:05.579439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af365-bab8-43e2-a1b0-1f96b618a7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:05.579826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af365-bab8-43e2-a1b0-1f96b618a7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:05.674148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41af365-bab8-43e2-a1b0-1f96b618a7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:05.675817 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41af365-bab8-43e2-a1b0-1f96b618a7e2 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:05.718586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1201/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:10.801058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:10.815927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:10.868772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9da963-0ef9-425c-95ad-39a7bcdf9a2b service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:10.877132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:10.878238 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:10.878877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:10.879313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] PATH_INFO: `/v3/users/c49b1f19ae20433b9a88476aaec23882` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:10.880681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49b1f19ae20433b9a88476aaec23882)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:10.883114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:11.191820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49b1f19ae20433b9a88476aaec23882'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:11.244268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49b1f19ae20433b9a88476aaec23882'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:11.244936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49b1f19ae20433b9a88476aaec23882'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:11.245775 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49b1f19ae20433b9a88476aaec23882'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:11.255067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49b1f19ae20433b9a88476aaec23882'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:11.274347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1223/2424] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:10 2022] DELETE /identity/v3/users/c49b1f19ae20433b9a88476aaec23882 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:11.278859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafba6f-2541-482e-910d-7b6452860856 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:11.279381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafba6f-2541-482e-910d-7b6452860856 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:11.279473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafba6f-2541-482e-910d-7b6452860856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:11.342911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-baafba6f-2541-482e-910d-7b6452860856 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:11.344226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-baafba6f-2541-482e-910d-7b6452860856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:11.393745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:11.440004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1202/2425] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:11.449729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:11.451145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:11.511595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaabe95-28ab-4297-acd8-7a43e650fdd4 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:11.516459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:11.517066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:11.517348 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:11.517649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:11.527186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:11.528640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:11.538076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1224/2426] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:11.989347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafba6f-2541-482e-910d-7b6452860856 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:11.991129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-baafba6f-2541-482e-910d-7b6452860856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:12.003757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafba6f-2541-482e-910d-7b6452860856 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:12.011246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:12.012367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:12.012367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:12.012720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] PATH_INFO: `/v3/projects/c5182198483c4092b909df2f476de217` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:12.014660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5182198483c4092b909df2f476de217)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:12.017006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:12.123541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5182198483c4092b909df2f476de217', 'request_id': 'req-9a2f1776-1399-48c8-ba61-e4757d964a48'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.129891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5182198483c4092b909df2f476de217', 'request_id': 'req-9a2f1776-1399-48c8-ba61-e4757d964a48'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.186331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5182198483c4092b909df2f476de217', 'request_id': 'req-9a2f1776-1399-48c8-ba61-e4757d964a48'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.196962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] The token cache is being invalidate because project c5182198483c4092b909df2f476de217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:12.197238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.197864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.199395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1203/2427] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:11 2022] DELETE /identity/v3/projects/c5182198483c4092b909df2f476de217 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:12.208628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:12.221743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b41d4-f3f7-49d9-8ab8-ccd506b8c2c2 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:12.248426 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:12.280480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:12.281336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:12.281611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:12.281879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] PATH_INFO: `/v3/users/f498a8ea7a0246669d25d0244012e6af` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:12.282986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f498a8ea7a0246669d25d0244012e6af)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:12.284984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:12.395043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:12.396515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:12.474307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f498a8ea7a0246669d25d0244012e6af'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.475550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1776-1399-48c8-ba61-e4757d964a48 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:12.479534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:12.480170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:12.480490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:12.480763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:12.482597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:12.494404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:12.495833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:12.505628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1204/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:12.556733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f498a8ea7a0246669d25d0244012e6af'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.557446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f498a8ea7a0246669d25d0244012e6af'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.558087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f498a8ea7a0246669d25d0244012e6af'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.567465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-deeee54b-fb3e-43a8-a586-3cab52bb92d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f498a8ea7a0246669d25d0244012e6af'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:12.585477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1225/2429] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:12 2022] DELETE /identity/v3/users/f498a8ea7a0246669d25d0244012e6af => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:13.063861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:13.066017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:13.078794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c92eb-fa64-4b93-8511-949f2367169e service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:13.114802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:13.147395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:13.147996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.148298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.150563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] PATH_INFO: `/v3/projects/ddc19e665cec4acdb7f144dbc7d278dd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.150563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc19e665cec4acdb7f144dbc7d278dd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:13.151902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:13.284434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc19e665cec4acdb7f144dbc7d278dd', 'request_id': 'req-afa25bed-9bc7-4348-a7cf-c5c4e8879535'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:13.290640 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc19e665cec4acdb7f144dbc7d278dd', 'request_id': 'req-afa25bed-9bc7-4348-a7cf-c5c4e8879535'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:13.359067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc19e665cec4acdb7f144dbc7d278dd', 'request_id': 'req-afa25bed-9bc7-4348-a7cf-c5c4e8879535'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:13.372131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] The token cache is being invalidate because project ddc19e665cec4acdb7f144dbc7d278dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:13.372131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:13.372131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afa25bed-9bc7-4348-a7cf-c5c4e8879535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:13.372765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1205/2430] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:13 2022] DELETE /identity/v3/projects/ddc19e665cec4acdb7f144dbc7d278dd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:13.378478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.378966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.379155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.439890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:13.441142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:13.527038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1226/2431] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:13.537243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.537883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.537883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.561344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:13.562762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:13.572501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1206/2432] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:13.577908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:13.589665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4d16f-fe29-4543-894a-5f233e063acc None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:13.599350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:13.600126 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.600526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.601183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.602113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:13.602569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:13.604459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:13.618208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1227/2433] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:13.622766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:13.633093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eea15-9ac1-49e0-9e4e-9645332e8bf3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:13.638085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:13.639349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.639689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.640141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.641047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:13.647455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:13.755268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1207/2434] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:13 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:13.759956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:13.770804 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eee553-09b8-4cea-a83e-89d082489656 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:13.780231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:13.834060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:13.834588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.834865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.835138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.835787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:13.837743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:13.973808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1228/2435] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:13 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:13.975143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:13.987203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad273291-a349-4085-aad9-b6d407b84157 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:13.992016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:13.992769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:13.993057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:13.993393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:13.994192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:13.995849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:14.006219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1208/2436] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:14.010372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:14.031330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0b3a-1253-4e2f-8174-da4b1c6d9fa9 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:14.039922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b9052-3219-452a-95eb-8ba7ec4648f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:14.040675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9052-3219-452a-95eb-8ba7ec4648f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:14.040960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9052-3219-452a-95eb-8ba7ec4648f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:14.041237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b9052-3219-452a-95eb-8ba7ec4648f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:14.044518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b9052-3219-452a-95eb-8ba7ec4648f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:14.044518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b9052-3219-452a-95eb-8ba7ec4648f5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:14.057158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1229/2437] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:14.062906 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:14.077243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63552c0-f696-41e6-a6ef-ba7827a2c338 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:14.081949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:14.082686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:14.083036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:14.083380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] PATH_INFO: `/v3/projects/086e76b2cc8b47169ad4a0ec77f15b3f/users/a6059f5599da40d4b81439018bf34737/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:14.105704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] RBAC: Authorizing `identity:create_grant(project_id=086e76b2cc8b47169ad4a0ec77f15b3f, user_id=a6059f5599da40d4b81439018bf34737, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:14.110188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:14.204723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1209/2438] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:14 2022] PUT /identity/v3/projects/086e76b2cc8b47169ad4a0ec77f15b3f/users/a6059f5599da40d4b81439018bf34737/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:14.210036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ac30c-2534-46da-8263-b962634b270f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:14.210330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ac30c-2534-46da-8263-b962634b270f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:14.210617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ac30c-2534-46da-8263-b962634b270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:14.229820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-281ac30c-2534-46da-8263-b962634b270f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:14.231027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-281ac30c-2534-46da-8263-b962634b270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:14.299402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1230/2439] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:14.312056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:14.314114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:14.381133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:14.419617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44150b-74f6-4436-a4b5-bfa6ca04373a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:14.424996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:14.427132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:14.427132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:14.427394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:14.438567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:14.440128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:14.450583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1210/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:16.090434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.091005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.091005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.122111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] MFA Rules not processed for user `a6059f5599da40d4b81439018bf34737`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:16.123961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:16.205838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1231/2441] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:16.209850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.223252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5305e29-8460-46ed-8c22-39f81a236814 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.228811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:16.229547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.229699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.229959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.230742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:16.233503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:16.337981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.341241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:16.353785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1211/2442] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:16.354914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.394148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:16.434543 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23b1a-3983-436b-998f-f4a58d512c9b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.442273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:16.442897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.443182 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.443699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.445478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:16.448400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:16.492278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada4ce2-9ef0-4474-89d2-32ca0415588d None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.551001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1212/2443] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:16 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:16.551838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.553619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:16.568440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17b2f9-70b4-4454-ba42-77f5edd84cb9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.568572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:16.568927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.569208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.569536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.571429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:16.572069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:16.572755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.573047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.573353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] PATH_INFO: `/v3/users/5111139cdb444281b95871311f9c7f5d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.574468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5111139cdb444281b95871311f9c7f5d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:16.577314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:16.587024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:16.588719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:16.599233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1232/2444] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:16.600561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.611359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6ce5-650c-4971-a7d1-e12285160bc2 service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.615970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:16.616606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.616885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.617240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.617876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:16.619448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:16.633564 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1233/2445] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:16.634680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.645201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7a7e-3390-4e0e-afc3-e36f2724c526 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.650910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:16.651496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:16.651776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:16.652063 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] PATH_INFO: `/v3/projects/4d20443dd3964307b804f69c2170ac12/users/48be5d256e724071ab345ab554afbbf5/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:16.669015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d20443dd3964307b804f69c2170ac12, user_id=48be5d256e724071ab345ab554afbbf5, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:16.671889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:16.773312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5111139cdb444281b95871311f9c7f5d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:16.861490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5111139cdb444281b95871311f9c7f5d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:16.862098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5111139cdb444281b95871311f9c7f5d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:16.862714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5111139cdb444281b95871311f9c7f5d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:16.871217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1234/2446] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:16 2022] PUT /identity/v3/projects/4d20443dd3964307b804f69c2170ac12/users/48be5d256e724071ab345ab554afbbf5/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:16.872246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:16.874509 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:16.874833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5111139cdb444281b95871311f9c7f5d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:16.896076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1213/2447] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:16 2022] DELETE /identity/v3/users/5111139cdb444281b95871311f9c7f5d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:16.942098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918d214-3d78-41de-a619-d275790ac158 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:16.964759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:17.003050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:17.003654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.004350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.004633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.005275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:17.006890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:17.017356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1235/2448] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:17.021444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:17.031901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705e7d-4035-4780-b621-7a2b683d9668 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:17.037603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3bfbe-d599-4cd0-bb0f-6b901c09c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:17.037775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3bfbe-d599-4cd0-bb0f-6b901c09c631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.038174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3bfbe-d599-4cd0-bb0f-6b901c09c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.038464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3bfbe-d599-4cd0-bb0f-6b901c09c631 admin admin] PATH_INFO: `/v3/projects/4d20443dd3964307b804f69c2170ac12/users/48be5d256e724071ab345ab554afbbf5/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.040361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3bfbe-d599-4cd0-bb0f-6b901c09c631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d20443dd3964307b804f69c2170ac12, user_id=48be5d256e724071ab345ab554afbbf5, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:17.043143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3bfbe-d599-4cd0-bb0f-6b901c09c631 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:17.049913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:17.055262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1214/2449] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:17 2022] PUT /identity/v3/projects/4d20443dd3964307b804f69c2170ac12/users/48be5d256e724071ab345ab554afbbf5/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:17.204251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:17.206077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:17.221473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3d59a-2de1-43e8-993a-64788a1c4fcb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:17.284541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:17.290400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.290400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.290400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] PATH_INFO: `/v3/projects/9c7cc5b2fd13440e8256a957874e6684` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.290400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7cc5b2fd13440e8256a957874e6684)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:17.290400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:17.387829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7cc5b2fd13440e8256a957874e6684', 'request_id': 'req-191047a2-f566-447d-aa49-c281b5d2635e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:17.396016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7cc5b2fd13440e8256a957874e6684', 'request_id': 'req-191047a2-f566-447d-aa49-c281b5d2635e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:17.438458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7cc5b2fd13440e8256a957874e6684', 'request_id': 'req-191047a2-f566-447d-aa49-c281b5d2635e'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:17.450005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] The token cache is being invalidate because project 9c7cc5b2fd13440e8256a957874e6684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:17.450327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:17.451672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-191047a2-f566-447d-aa49-c281b5d2635e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:17.453394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1236/2450] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:17 2022] DELETE /identity/v3/projects/9c7cc5b2fd13440e8256a957874e6684 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:17.458361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.458997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.459458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.479536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:17.480767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:17.543016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1215/2451] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:17.551550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.565919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.565919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.573188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:17.574518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:17.582914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1237/2452] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:17.587276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:17.610400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509a1a-ff80-4e28-b8ba-147403eecef8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:17.616677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:17.617387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.617729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.618020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.618802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:17.619008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:17.620721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:17.646723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1216/2453] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:12:17.650733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:17.668819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713bb14-7d21-468f-b0c6-7233d8ca3d34 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:17.674501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:17.675217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.675902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.676210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.676940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:17.681996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:17.780515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1238/2454] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:17 2022] POST /identity/v3/projects => generated 403 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:17.786669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:17.798261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2d8d-4a3e-404a-bf6c-cb230eb36a51 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:17.862956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:17.863687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:17.864053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:17.864426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:17.865102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:17.867075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:17.997249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1217/2455] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:17 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:17.997399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:18.001309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1639-25ac-4520-84be-79ea73875b6a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:18.005867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:18.006475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.006738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.007008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.007642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:18.009347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:18.019922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1239/2456] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:18.024106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:18.034856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feca0e-5ba0-4b52-b255-8ef6c87469df admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:18.039712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49e3f5-ba0e-47c3-bb16-65dc53e4de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:18.040376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e3f5-ba0e-47c3-bb16-65dc53e4de8e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.040693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e3f5-ba0e-47c3-bb16-65dc53e4de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.040969 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49e3f5-ba0e-47c3-bb16-65dc53e4de8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.041602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e3f5-ba0e-47c3-bb16-65dc53e4de8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:18.043258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49e3f5-ba0e-47c3-bb16-65dc53e4de8e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:18.060020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1218/2457] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:18.060180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:18.069958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff532e-3cbb-46dd-a9d9-306537832a9f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:18.074528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:18.075170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.075553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.080192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] PATH_INFO: `/v3/projects/03a9e01fb3124ac4a8aa470e0e56fe73/users/b2bb7eaed43f4784aa900a6e6c9ecf8a/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.089079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:18.095858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9e01fb3124ac4a8aa470e0e56fe73, user_id=b2bb7eaed43f4784aa900a6e6c9ecf8a, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:18.098562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:18.180424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1240/2458] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:18 2022] PUT /identity/v3/projects/03a9e01fb3124ac4a8aa470e0e56fe73/users/b2bb7eaed43f4784aa900a6e6c9ecf8a/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:18.186215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5e05-9258-4d2f-b72d-afe083db8336 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.186662 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5e05-9258-4d2f-b72d-afe083db8336 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.186946 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5e05-9258-4d2f-b72d-afe083db8336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.206973 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-392d5e05-9258-4d2f-b72d-afe083db8336 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:18.208175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-392d5e05-9258-4d2f-b72d-afe083db8336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:18.267861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1219/2459] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:18.277541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:18.279942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:18.343007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341eaae-9286-46d5-9884-aede0af0ed37 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:18.343918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51678e3b-a03f-4f4f-a37e-78c954d74457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:18.344560 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678e3b-a03f-4f4f-a37e-78c954d74457 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.344842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678e3b-a03f-4f4f-a37e-78c954d74457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.345115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678e3b-a03f-4f4f-a37e-78c954d74457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.354623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51678e3b-a03f-4f4f-a37e-78c954d74457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:18.356151 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51678e3b-a03f-4f4f-a37e-78c954d74457 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:18.365761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1241/2460] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:18.429579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.429914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.430146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.440257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:18.460203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] MFA Rules not processed for user `48be5d256e724071ab345ab554afbbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:18.461762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:18.546706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1220/2461] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:18.614196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd643f-ffba-4333-a0c4-2fa904e375cf None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.614481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd643f-ffba-4333-a0c4-2fa904e375cf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.614753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd643f-ffba-4333-a0c4-2fa904e375cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.633730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-22fd643f-ffba-4333-a0c4-2fa904e375cf None None] MFA Rules not processed for user `a6059f5599da40d4b81439018bf34737`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:18.634916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-22fd643f-ffba-4333-a0c4-2fa904e375cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:18.694037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1242/2462] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:18.706787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:18.708248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:18.784400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9e7a-7bc4-426c-8178-4074992e2096 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:18.790153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:18.792450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:18.792450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:18.792450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:18.793130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:18.803355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:18.804965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:18.814701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1221/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:19.673139 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:19.673591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:19.673770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:19.716682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] MFA Rules not processed for user `b2bb7eaed43f4784aa900a6e6c9ecf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:19.716682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:19.780710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1243/2464] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:19.785408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:19.796216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ae224-4eb6-494b-8d1f-90a4ac575793 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:19.800794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:19.801414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:19.801692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:19.801964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:19.802612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:19.804562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:19.922513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1222/2465] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:19 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:19.923555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:19.934328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b90367-7c4e-4cd5-b7b6-fd5362e89681 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:19.955184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:19.993115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:19.993724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:19.994005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:19.994281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:19.994913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:19.996932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:20.107519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1244/2466] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:19 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:20.111453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:20.121632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba81c-6b02-4097-86fa-f3dba05f0a08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:20.126799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:20.127385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:20.127660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:20.127933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:20.128599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:20.130202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:20.140344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1223/2467] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:20.144620 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:20.154834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cf8c0-8992-4bbf-a015-6e7358a17c82 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:20.159453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:20.160097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:20.160409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:20.160687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] PATH_INFO: `/v3/projects/de46a0ced0014cb98418293343f6f74f/users/97d20ccc02d94af1bdd03c139e44c072/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:20.179207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de46a0ced0014cb98418293343f6f74f, user_id=97d20ccc02d94af1bdd03c139e44c072, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:20.179207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:20.283143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1245/2468] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:20 2022] PUT /identity/v3/projects/de46a0ced0014cb98418293343f6f74f/users/97d20ccc02d94af1bdd03c139e44c072/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:20.287325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:20.297468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe28f-299a-4a10-a91c-02a1c0bfff78 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:20.337937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:20.354140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f84f8b-79ba-48b9-92a6-3bd37c0d70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:20.354744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f84f8b-79ba-48b9-92a6-3bd37c0d70de admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:20.355025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f84f8b-79ba-48b9-92a6-3bd37c0d70de admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:20.355290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f84f8b-79ba-48b9-92a6-3bd37c0d70de admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:20.355917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f84f8b-79ba-48b9-92a6-3bd37c0d70de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:20.357669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f84f8b-79ba-48b9-92a6-3bd37c0d70de admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:20.367134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1224/2469] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:20.371516 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:20.383690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489785f-44e0-4f18-84f7-2f9c847eef59 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:20.389128 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:20.389779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:20.390054 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:20.390328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] PATH_INFO: `/v3/projects/de46a0ced0014cb98418293343f6f74f/users/97d20ccc02d94af1bdd03c139e44c072/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:20.392271 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de46a0ced0014cb98418293343f6f74f, user_id=97d20ccc02d94af1bdd03c139e44c072, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:20.394902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:20.406168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1246/2470] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:20 2022] PUT /identity/v3/projects/de46a0ced0014cb98418293343f6f74f/users/97d20ccc02d94af1bdd03c139e44c072/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:21.601590 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cad8-4740-4f56-b6ca-3d06be10bece None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:21.602136 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cad8-4740-4f56-b6ca-3d06be10bece None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:21.602252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cad8-4740-4f56-b6ca-3d06be10bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:21.639314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0ba2cad8-4740-4f56-b6ca-3d06be10bece None None] MFA Rules not processed for user `97d20ccc02d94af1bdd03c139e44c072`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:21.641486 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0ba2cad8-4740-4f56-b6ca-3d06be10bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:21.737458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1225/2471] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:22.338247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:22.340117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:22.424995 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca8213-a084-4633-a1eb-ec7b640a34b8 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:22.429631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:22.430282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:22.430562 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:22.430835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] PATH_INFO: `/v3/users/453f1d7b9726412e91112dcc59f51bdd` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:22.432017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453f1d7b9726412e91112dcc59f51bdd)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:22.433970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:22.667982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453f1d7b9726412e91112dcc59f51bdd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:22.792337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453f1d7b9726412e91112dcc59f51bdd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:22.793121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453f1d7b9726412e91112dcc59f51bdd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:22.794312 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453f1d7b9726412e91112dcc59f51bdd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:22.804153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453f1d7b9726412e91112dcc59f51bdd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:22.816156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:22.822940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1247/2472] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:22 2022] DELETE /identity/v3/users/453f1d7b9726412e91112dcc59f51bdd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:22.828151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:22.828687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:22.828926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:22.850114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:22.851765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:22.921607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1226/2473] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:22.942989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:22.946033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:23.026050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d7b69-4804-41da-bbee-aea6e7cd19e4 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:23.032705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:23.033624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:23.033624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:23.033948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:23.045309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:23.047469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:23.058379 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1248/2474] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:23.782985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:23.784814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:23.798270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f68ac1-f6e5-4480-93e6-e7913664d3ae None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:23.803145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:23.804266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:23.804266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:23.804510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] PATH_INFO: `/v3/projects/e6d059495a174851bda15d4e9467c083` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:23.805613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d059495a174851bda15d4e9467c083)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:23.807554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:23.857964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:23.860030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:23.873244 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017480c-c0a5-4d82-b96d-8eaa2cd2959f service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:23.878634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:23.879266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:23.879551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:23.879830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] PATH_INFO: `/v3/users/b2bb7eaed43f4784aa900a6e6c9ecf8a` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:23.880976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bb7eaed43f4784aa900a6e6c9ecf8a)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:23.882942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:23.923007 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d059495a174851bda15d4e9467c083', 'request_id': 'req-fd83d7b0-75f0-4138-b98a-87af5425eb86'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:23.929461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d059495a174851bda15d4e9467c083', 'request_id': 'req-fd83d7b0-75f0-4138-b98a-87af5425eb86'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:23.935074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:24.071671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d059495a174851bda15d4e9467c083', 'request_id': 'req-fd83d7b0-75f0-4138-b98a-87af5425eb86'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.084020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] The token cache is being invalidate because project e6d059495a174851bda15d4e9467c083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:24.084365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.085011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.086528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1227/2475] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:23 2022] DELETE /identity/v3/projects/e6d059495a174851bda15d4e9467c083 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:24.090365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:24.091701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:24.122557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bb7eaed43f4784aa900a6e6c9ecf8a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.161628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d7b0-75f0-4138-b98a-87af5425eb86 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:24.166281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:24.167035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:24.167320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:24.167594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] PATH_INFO: `/v3/users/e8b4339884b04522b587c0240b98fb54` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:24.168750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b4339884b04522b587c0240b98fb54)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:24.170697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:24.196683 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bb7eaed43f4784aa900a6e6c9ecf8a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.197306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bb7eaed43f4784aa900a6e6c9ecf8a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.197947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bb7eaed43f4784aa900a6e6c9ecf8a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.206424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bb7eaed43f4784aa900a6e6c9ecf8a'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.225180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1249/2476] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:23 2022] DELETE /identity/v3/users/b2bb7eaed43f4784aa900a6e6c9ecf8a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:24.336145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b4339884b04522b587c0240b98fb54'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.410984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b4339884b04522b587c0240b98fb54'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.411644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b4339884b04522b587c0240b98fb54'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.412323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b4339884b04522b587c0240b98fb54'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.421421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b4339884b04522b587c0240b98fb54'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:24.441339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1228/2477] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:24 2022] DELETE /identity/v3/users/e8b4339884b04522b587c0240b98fb54 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:24.683800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:24.685447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:24.774591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422145e-156f-4a91-95c6-962d4191abd2 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:24.791201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:24.845694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:24.846267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:24.846553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:24.846899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] PATH_INFO: `/v3/projects/03a9e01fb3124ac4a8aa470e0e56fe73` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:24.848094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a9e01fb3124ac4a8aa470e0e56fe73)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:24.850037 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:24.944625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:24.946583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:24.980823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d6e9-f131-431b-a6eb-f3e01b3b2014 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.010856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a9e01fb3124ac4a8aa470e0e56fe73', 'request_id': 'req-91ac8b89-39d0-4bbd-910a-60bad9178b58'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.024215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a9e01fb3124ac4a8aa470e0e56fe73', 'request_id': 'req-91ac8b89-39d0-4bbd-910a-60bad9178b58'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.066467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.067242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.067520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.067796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] PATH_INFO: `/v3/projects/6f992d181258480c99244aa6a4f9ecca` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.068933 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f992d181258480c99244aa6a4f9ecca)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.070858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.080671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:25.112016 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a9e01fb3124ac4a8aa470e0e56fe73', 'request_id': 'req-91ac8b89-39d0-4bbd-910a-60bad9178b58'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.127374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] The token cache is being invalidate because project 03a9e01fb3124ac4a8aa470e0e56fe73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:25.127839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.128629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.130381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1250/2478] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:24 2022] DELETE /identity/v3/projects/03a9e01fb3124ac4a8aa470e0e56fe73 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:25.133987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.135535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:25.149233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8b89-39d0-4bbd-910a-60bad9178b58 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.154371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.155381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.155381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.155611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] PATH_INFO: `/v3/users/97d20ccc02d94af1bdd03c139e44c072` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.156792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d20ccc02d94af1bdd03c139e44c072)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.158696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.191703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f992d181258480c99244aa6a4f9ecca', 'request_id': 'req-67600646-1365-4f59-867f-38c46969d075'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.201475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f992d181258480c99244aa6a4f9ecca', 'request_id': 'req-67600646-1365-4f59-867f-38c46969d075'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.283157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f992d181258480c99244aa6a4f9ecca', 'request_id': 'req-67600646-1365-4f59-867f-38c46969d075'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.294808 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] The token cache is being invalidate because project 6f992d181258480c99244aa6a4f9ecca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:25.295096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.296265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-67600646-1365-4f59-867f-38c46969d075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.297927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1229/2479] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:24 2022] DELETE /identity/v3/projects/6f992d181258480c99244aa6a4f9ecca => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:25.302701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00c09-ce83-4f0f-82eb-30e373501711 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.303427 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00c09-ce83-4f0f-82eb-30e373501711 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.303779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00c09-ce83-4f0f-82eb-30e373501711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.317109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d20ccc02d94af1bdd03c139e44c072'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.325174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a5a00c09-ce83-4f0f-82eb-30e373501711 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:25.326533 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5a00c09-ce83-4f0f-82eb-30e373501711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:25.379851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d20ccc02d94af1bdd03c139e44c072'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.380633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d20ccc02d94af1bdd03c139e44c072'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.381268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d20ccc02d94af1bdd03c139e44c072'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.390120 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d20ccc02d94af1bdd03c139e44c072'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.395176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1230/2480] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:25.403198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.403492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.403776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.412209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1251/2481] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:25 2022] DELETE /identity/v3/users/97d20ccc02d94af1bdd03c139e44c072 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:25.425594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:25.426788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:25.488591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1231/2482] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:25.492856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.503850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e465b3-7ad0-47e0-8390-45f14e01ed47 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.509753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.509753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.510038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.510319 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.510973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:25.511276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.512882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.525666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1252/2483] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:25.530312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.539733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ce830-ea89-4cc6-a229-40fd79826178 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.545321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.546623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.546940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.547220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.547859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.549970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.616116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1232/2484] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:25 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:25.620442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.631256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315fa6-e027-44cf-863d-9c463c059fbc admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.634660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:25.685428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.690305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:25.691256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.692372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.692372 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.692551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.693164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.694960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.705771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1dcb6e-361a-4af3-9602-c4d01ff506d0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.711038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.711765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.712205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.712516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] PATH_INFO: `/v3/projects/de46a0ced0014cb98418293343f6f74f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.713712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de46a0ced0014cb98418293343f6f74f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.715646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.727839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:25.763592 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1253/2485] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:25 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:25.768292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.778337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068079b-65bc-47ce-adcd-dad20f5f9bfd admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.783794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.784408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.784761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.784963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.785625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.787181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.798406 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1254/2486] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:25.802315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.812134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95f66-2d32-4c8b-937b-6b44e41e118d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.825797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de46a0ced0014cb98418293343f6f74f', 'request_id': 'req-4cded864-c34f-4f61-a3b0-8c3a21e37918'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.831984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de46a0ced0014cb98418293343f6f74f', 'request_id': 'req-4cded864-c34f-4f61-a3b0-8c3a21e37918'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.868129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.868768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.869049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.869321 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.869961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.871627 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.882236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1255/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:25.885963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:25.895514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a0a-25c5-47be-8fed-f1bf9dc78ed2 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:25.900256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec9c43-435d-47a9-9c58-86f9440ede47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:25.900912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9c43-435d-47a9-9c58-86f9440ede47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.901197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9c43-435d-47a9-9c58-86f9440ede47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.901474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec9c43-435d-47a9-9c58-86f9440ede47 admin admin] PATH_INFO: `/v3/projects/793bef26d0364dd18765e4872b49c700/users/6dcbc51409154d6a932d23162c6b0612/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.912197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de46a0ced0014cb98418293343f6f74f', 'request_id': 'req-4cded864-c34f-4f61-a3b0-8c3a21e37918'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.916230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec9c43-435d-47a9-9c58-86f9440ede47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793bef26d0364dd18765e4872b49c700, user_id=6dcbc51409154d6a932d23162c6b0612, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:25.919050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec9c43-435d-47a9-9c58-86f9440ede47 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:25.923992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] The token cache is being invalidate because project de46a0ced0014cb98418293343f6f74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:25.924283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.925008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4cded864-c34f-4f61-a3b0-8c3a21e37918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:25.926507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1233/2488] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:25 2022] DELETE /identity/v3/projects/de46a0ced0014cb98418293343f6f74f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:25.931113 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797f30-d43f-49b0-b106-1b4d28f08be3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.931396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797f30-d43f-49b0-b106-1b4d28f08be3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.931724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9797f30-d43f-49b0-b106-1b4d28f08be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.950706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b9797f30-d43f-49b0-b106-1b4d28f08be3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:25.952520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b9797f30-d43f-49b0-b106-1b4d28f08be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:25.960483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1234/2489] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:25.968668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:25.968866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:25.969140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:25.990323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:25.991488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:25.999308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1235/2490] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:26.003408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.009323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1256/2491] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:25 2022] PUT /identity/v3/projects/793bef26d0364dd18765e4872b49c700/users/6dcbc51409154d6a932d23162c6b0612/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:26.013580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6cce3-886c-444f-9e1a-c1d4f620ca80 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.024737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.025296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.025296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.054774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] MFA Rules not processed for user `6dcbc51409154d6a932d23162c6b0612`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:26.056081 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:26.078715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.079318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.079595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.079861 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.080545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:26.081124 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.083738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.095814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1236/2492] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:12:26.100032 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.103373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:26.109964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9a01-28e8-450c-8923-6623640f40f8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.114664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.115240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.115514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.115785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.116429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.118309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.123351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1257/2493] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:26.128526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.129947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:26.143991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be39ecd-273f-46dc-a7e0-e56469a964fb None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.148518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.149241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.149514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.149788 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.150410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.152291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.203638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1237/2494] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:26.207838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.263837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1258/2495] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:26.265286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.269746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:26.274841 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55233131-3880-4c22-8217-c19e3ca9e447 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.343979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.344777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.345066 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.345339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.345982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.346971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44de8f-12ac-4318-8402-018e1d1f8443 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.348073 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.352358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.353288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.355892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.355892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.355892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.356453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.443697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1238/2496] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/users => generated 282 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:26.447500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.457133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1259/2497] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:26.458308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b154bf-0726-4724-bc2c-642c27756f4b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.461704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.463127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.463725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.464009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.464283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.465002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.466586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.471883 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc873747-5a21-4fb2-afac-3c7133b088cb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.476851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.477433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.477710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.478167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.478287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1239/2498] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:26.478655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.480220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.481878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.492460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40164a78-6d26-46d9-9dd8-ebf28f8da2c7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.496166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1260/2499] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:26.497168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.497303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.497767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.498050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.498326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.499756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.502144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.510329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0f41-3f97-4ad9-ab68-10f6a5a66e5a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.516461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.517114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.517387 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.517657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] PATH_INFO: `/v3/projects/b8305509eef149a8a286c00d32fff395/users/3af0aa780fe24b66a2cf1e7ab2ccf4c4/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.519749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1240/2500] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:26.523852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.533873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cffbd1-d7b6-47f2-9868-7922971cf88b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.536216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8305509eef149a8a286c00d32fff395, user_id=3af0aa780fe24b66a2cf1e7ab2ccf4c4, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.538922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.539360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f6b7-0e9e-4503-aa37-712b525dc908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.540000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f6b7-0e9e-4503-aa37-712b525dc908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.540282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f6b7-0e9e-4503-aa37-712b525dc908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.540584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f6b7-0e9e-4503-aa37-712b525dc908 admin admin] PATH_INFO: `/v3/projects/ebe4e383f3af434387860be316fe1c90/users/f80dbfd2c48c4efcbddd857820131116/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.555844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f6b7-0e9e-4503-aa37-712b525dc908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe4e383f3af434387860be316fe1c90, user_id=f80dbfd2c48c4efcbddd857820131116, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.558498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f6b7-0e9e-4503-aa37-712b525dc908 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.625267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1261/2501] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:26 2022] PUT /identity/v3/projects/b8305509eef149a8a286c00d32fff395/users/3af0aa780fe24b66a2cf1e7ab2ccf4c4/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:26.629185 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.660653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1241/2502] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:26 2022] PUT /identity/v3/projects/ebe4e383f3af434387860be316fe1c90/users/f80dbfd2c48c4efcbddd857820131116/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:26.671460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.671891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.672241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.690278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4d3b-0a4d-47cc-bf3b-565f552f4e42 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.701006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] MFA Rules not processed for user `f80dbfd2c48c4efcbddd857820131116`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:26.702391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:26.714589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:26.746708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.747735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.748014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.748330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.749640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.751228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.761093 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1262/2503] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:26.765582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.768799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1242/2504] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:26.773065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.775888 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e12c-80ea-4c5b-a7fb-97011ac32a27 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.780902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab6e08-863d-4ff9-82e4-30cbca67d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.781553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6e08-863d-4ff9-82e4-30cbca67d752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.781833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6e08-863d-4ff9-82e4-30cbca67d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.782110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab6e08-863d-4ff9-82e4-30cbca67d752 admin admin] PATH_INFO: `/v3/projects/b8305509eef149a8a286c00d32fff395/users/3af0aa780fe24b66a2cf1e7ab2ccf4c4/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.783328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75963f03-e18e-430b-a652-c1acc6d17739 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.784041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab6e08-863d-4ff9-82e4-30cbca67d752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8305509eef149a8a286c00d32fff395, user_id=3af0aa780fe24b66a2cf1e7ab2ccf4c4, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.786731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab6e08-863d-4ff9-82e4-30cbca67d752 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.787858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.788485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.788768 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.789049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.789675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.791559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:26.797955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1263/2505] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:26 2022] PUT /identity/v3/projects/b8305509eef149a8a286c00d32fff395/users/3af0aa780fe24b66a2cf1e7ab2ccf4c4/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:26.808327 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.808625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.808901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.837272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] MFA Rules not processed for user `3af0aa780fe24b66a2cf1e7ab2ccf4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:26.838478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:26.901914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1243/2506] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:26.906000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.907843 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1264/2507] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:26.918210 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:26.919543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:26.926761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:26.971572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53c46-f88d-44b8-96b5-e1ae6adf078e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:26.976603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:26.977209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:26.977490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:26.977770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:26.978401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:26.980324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.001340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefd04f-26fa-440d-83b7-dfd57f296e5c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.031368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:27.054920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.055530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.055811 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.056088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.078172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1244/2508] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:26 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:27.082348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.095742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6031e-b2e7-4290-914f-1059a37f42f6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.100818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.101693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.101972 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.102252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.103027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.104659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.116907 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1245/2509] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:27.120267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.120965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.121730 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.133926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb389940-a1fb-485a-9862-d42387d0c4b8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.136106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1265/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:26 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:27.139188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.140980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.141303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.141616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] PATH_INFO: `/v3/projects/10b91117de8145f0b8ead56690bc066f/users/ccd02e58b4224d9e9ae08a22e3a2c0da/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.160893 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b91117de8145f0b8ead56690bc066f, user_id=ccd02e58b4224d9e9ae08a22e3a2c0da, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.163849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.192558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.195784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:27.209822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e8a8-5eb9-4785-a06a-fda2ba7114d5 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.213721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.214549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.214831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.215106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.275355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.276828 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.287038 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1266/2511] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:27.364140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1246/2512] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:27 2022] PUT /identity/v3/projects/10b91117de8145f0b8ead56690bc066f/users/ccd02e58b4224d9e9ae08a22e3a2c0da/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:27.368360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.379846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09846b4d-918d-4a31-ae8f-3835e2d99ee9 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.445133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce6d1-4c85-443b-b85a-285c27e9b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.445758 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce6d1-4c85-443b-b85a-285c27e9b658 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.446280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce6d1-4c85-443b-b85a-285c27e9b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.446280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce6d1-4c85-443b-b85a-285c27e9b658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.447049 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce6d1-4c85-443b-b85a-285c27e9b658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.448860 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce6d1-4c85-443b-b85a-285c27e9b658 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.464934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1267/2513] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:27.466606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.479469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7e6cc-bfc4-477b-be17-e7b415819e79 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.484438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.485095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.485501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.485783 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] PATH_INFO: `/v3/projects/10b91117de8145f0b8ead56690bc066f/users/ccd02e58b4224d9e9ae08a22e3a2c0da/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.488009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b91117de8145f0b8ead56690bc066f, user_id=ccd02e58b4224d9e9ae08a22e3a2c0da, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.490690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.502152 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1247/2514] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:27 2022] PUT /identity/v3/projects/10b91117de8145f0b8ead56690bc066f/users/ccd02e58b4224d9e9ae08a22e3a2c0da/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:27.513824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.514101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.514934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.544423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] MFA Rules not processed for user `ccd02e58b4224d9e9ae08a22e3a2c0da`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:27.546212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:27.550299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:27.640068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1268/2515] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:27.651679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.708954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69eb6a-d660-45cb-991f-4624d895e757 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.712581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.713176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.713454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.714560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:27.726132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:27.727561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:27.738369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1248/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:27.956000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:27.965626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b95534-e53e-4a4e-817d-57e4a8aa369e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:27.969708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11027e-8699-47cc-ad29-17f1103d4f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:27.970313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11027e-8699-47cc-ad29-17f1103d4f39 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:27.970593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11027e-8699-47cc-ad29-17f1103d4f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:27.970868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11027e-8699-47cc-ad29-17f1103d4f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:28.027754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11027e-8699-47cc-ad29-17f1103d4f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:28.029343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11027e-8699-47cc-ad29-17f1103d4f39 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:28.041520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1269/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:31.675904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:31.739157 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86422-6e3b-43af-9de5-45361b377442 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:31.743669 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:31.744288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:31.744591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:31.744864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] PATH_INFO: `/v3/users/f80dbfd2c48c4efcbddd857820131116` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:31.745965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80dbfd2c48c4efcbddd857820131116)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:31.747867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:31.749331 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:31.953942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80dbfd2c48c4efcbddd857820131116'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.032138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80dbfd2c48c4efcbddd857820131116'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.033126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80dbfd2c48c4efcbddd857820131116'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.034011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80dbfd2c48c4efcbddd857820131116'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.044042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80dbfd2c48c4efcbddd857820131116'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.062471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1249/2518] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:31 2022] DELETE /identity/v3/users/f80dbfd2c48c4efcbddd857820131116 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:32.067140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:32.067641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:32.067763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:32.087570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:32.088827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.148688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1270/2519] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:32.159271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:32.160723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.219445 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ad4b-bdb7-4b81-968f-53544de5ec7f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:32.223668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:32.224278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:32.224581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:32.224860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:32.235507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:32.236964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:32.246545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1250/2520] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:32.466149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:32.467735 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.480182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a50ae-0657-4227-81a6-e14b2caadd4c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:32.486006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:32.486782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:32.486918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:32.487181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] PATH_INFO: `/v3/users/6dcbc51409154d6a932d23162c6b0612` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:32.488400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcbc51409154d6a932d23162c6b0612)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:32.490398 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:32.713658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:32.714176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:32.715668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.731797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e32d6-fcfa-451c-a5fb-587bde8019e8 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:32.733787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcbc51409154d6a932d23162c6b0612'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.745033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be734db-d761-4267-a037-1713357af21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:32.745673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be734db-d761-4267-a037-1713357af21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:32.745980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be734db-d761-4267-a037-1713357af21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:32.746257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be734db-d761-4267-a037-1713357af21c admin admin] PATH_INFO: `/v3/projects/ebe4e383f3af434387860be316fe1c90` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:32.747391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be734db-d761-4267-a037-1713357af21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe4e383f3af434387860be316fe1c90)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:32.749354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be734db-d761-4267-a037-1713357af21c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:32.803320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcbc51409154d6a932d23162c6b0612'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.803991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcbc51409154d6a932d23162c6b0612'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.804631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcbc51409154d6a932d23162c6b0612'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.812548 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-91881da5-6bf7-4172-b483-20ef1c930737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcbc51409154d6a932d23162c6b0612'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.833236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1271/2521] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:32 2022] DELETE /identity/v3/users/6dcbc51409154d6a932d23162c6b0612 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:32.838772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:32.838772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:32.838772 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:32.848868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe4e383f3af434387860be316fe1c90', 'request_id': 'req-0be734db-d761-4267-a037-1713357af21c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.855348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe4e383f3af434387860be316fe1c90', 'request_id': 'req-0be734db-d761-4267-a037-1713357af21c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.858170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:32.859581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.917930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1272/2522] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:32.928948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:32.931636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.949999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe4e383f3af434387860be316fe1c90', 'request_id': 'req-0be734db-d761-4267-a037-1713357af21c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.961784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0be734db-d761-4267-a037-1713357af21c admin admin] The token cache is being invalidate because project ebe4e383f3af434387860be316fe1c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:32.962008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.962643 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:32.964121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1251/2523] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:32 2022] DELETE /identity/v3/projects/ebe4e383f3af434387860be316fe1c90 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:32.968247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:32.969588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:32.976977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:32.989854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385dc78-64c9-4e39-a1d3-f3f6d1215099 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:32.993526 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:32.994183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:32.994405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:32.994675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:32.996427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:33.008330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:33.009747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:33.019935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1273/2524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:33.038367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be734db-d761-4267-a037-1713357af21c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:33.043965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:33.044626 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:33.044934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:33.045207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] PATH_INFO: `/v3/users/ccd02e58b4224d9e9ae08a22e3a2c0da` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:33.046337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd02e58b4224d9e9ae08a22e3a2c0da)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:33.048270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:33.316163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd02e58b4224d9e9ae08a22e3a2c0da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.397547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd02e58b4224d9e9ae08a22e3a2c0da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.398161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd02e58b4224d9e9ae08a22e3a2c0da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.398790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd02e58b4224d9e9ae08a22e3a2c0da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.406335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd02e58b4224d9e9ae08a22e3a2c0da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.427927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1252/2525] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:32 2022] DELETE /identity/v3/users/ccd02e58b4224d9e9ae08a22e3a2c0da => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:33.480727 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:33.482296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:33.496530 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ad51-1ec7-418e-ae44-bcaa55d39f48 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:33.554183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:33.561706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:33.562345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:33.566477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:33.566477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] PATH_INFO: `/v3/projects/793bef26d0364dd18765e4872b49c700` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:33.566477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793bef26d0364dd18765e4872b49c700)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:33.566795 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:33.714132 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793bef26d0364dd18765e4872b49c700', 'request_id': 'req-3b595dea-daa1-4677-96a6-e6333918e4a4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.720242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793bef26d0364dd18765e4872b49c700', 'request_id': 'req-3b595dea-daa1-4677-96a6-e6333918e4a4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.854114 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793bef26d0364dd18765e4872b49c700', 'request_id': 'req-3b595dea-daa1-4677-96a6-e6333918e4a4'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.866094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] The token cache is being invalidate because project 793bef26d0364dd18765e4872b49c700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:33.866392 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.867045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:33.868732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1274/2526] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:33 2022] DELETE /identity/v3/projects/793bef26d0364dd18765e4872b49c700 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:33.872714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:33.874148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:33.892390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471a9c-c004-466a-8ba4-7c5d5d9acd03 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:33.895599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:33.897035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:33.961407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:33.962051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:33.962324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:33.962642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] PATH_INFO: `/v3/users/3af0aa780fe24b66a2cf1e7ab2ccf4c4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:33.963785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af0aa780fe24b66a2cf1e7ab2ccf4c4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:33.965751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:33.967939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b595dea-daa1-4677-96a6-e6333918e4a4 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:33.973702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:33.974355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:33.974661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:33.974943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] PATH_INFO: `/v3/projects/10b91117de8145f0b8ead56690bc066f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:33.976532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b91117de8145f0b8ead56690bc066f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:33.978499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.042576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:34.166247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af0aa780fe24b66a2cf1e7ab2ccf4c4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.170633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b91117de8145f0b8ead56690bc066f', 'request_id': 'req-f74d8573-d83a-488b-ae83-8f88724d232f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.178000 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b91117de8145f0b8ead56690bc066f', 'request_id': 'req-f74d8573-d83a-488b-ae83-8f88724d232f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.260248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af0aa780fe24b66a2cf1e7ab2ccf4c4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.260901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af0aa780fe24b66a2cf1e7ab2ccf4c4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.261535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af0aa780fe24b66a2cf1e7ab2ccf4c4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.269726 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0986e637-0056-4ad5-9ced-aaecd1372dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af0aa780fe24b66a2cf1e7ab2ccf4c4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.287983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1253/2527] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:33 2022] DELETE /identity/v3/users/3af0aa780fe24b66a2cf1e7ab2ccf4c4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:34.317520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b91117de8145f0b8ead56690bc066f', 'request_id': 'req-f74d8573-d83a-488b-ae83-8f88724d232f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.334733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] The token cache is being invalidate because project 10b91117de8145f0b8ead56690bc066f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:34.335021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.337925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f74d8573-d83a-488b-ae83-8f88724d232f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.340859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1275/2528] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:33 2022] DELETE /identity/v3/projects/10b91117de8145f0b8ead56690bc066f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:34.347415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.347703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.347984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.368439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:34.369646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:34.431158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1254/2529] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:34.438943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.441583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.441583 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.462233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:34.463436 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:34.471303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1276/2530] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:34.476002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.485818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dfc07-46ef-4480-b2f9-1fc1e01a1a47 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.491406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.492045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.492380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.499565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.499565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:34.499565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.499565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.512340 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1255/2531] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:34.513820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.527870 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03c2e-9210-4ead-84f7-59d3f2fa7770 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.530688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.531295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.532001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.532001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.532506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.534464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.540719 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:34.609086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1277/2532] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:34 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:34.610453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.622149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6145b40-74fa-4e9f-8f1a-56e9132daef8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.697560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.698179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.698458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.698766 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.699399 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.701498 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.745991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.747680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:34.789062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1256/2533] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:34 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:34.793142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.794769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:34.807293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ea2f0-f1ca-45ef-a809-210d0c1c0d49 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.812042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.812707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.812923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d05f9-73b8-46f6-ba6d-7f298f3cb670 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.813042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.813299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] PATH_INFO: `/v3/projects/b8305509eef149a8a286c00d32fff395` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.814438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8305509eef149a8a286c00d32fff395)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.816519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.816640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.817184 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.817461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.817733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.819470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:34.834479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:34.883257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.884723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.894586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1278/2534] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:34.895370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.906001 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208fe4c-18b1-422b-ad08-19a5d8a87b80 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.910383 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.910973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.911252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.911524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.912153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.913749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:34.924490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1279/2535] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:34.928536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:34.938862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa201e-841b-49f9-81ae-e5f26568429f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:34.950109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8305509eef149a8a286c00d32fff395', 'request_id': 'req-6a83e62e-f950-42a8-9fe1-007f1fd10876'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.957483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8305509eef149a8a286c00d32fff395', 'request_id': 'req-6a83e62e-f950-42a8-9fe1-007f1fd10876'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:34.994890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:34.995489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:34.995765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:34.996035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:34.996700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:34.998264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.007656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1280/2536] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:35.011595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.021777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59425f-7150-4c9d-ba2c-712cba9f5c8a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.026394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40b92-79bf-4a14-84bb-fcd398b1f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.027021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40b92-79bf-4a14-84bb-fcd398b1f842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.027300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40b92-79bf-4a14-84bb-fcd398b1f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.027688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40b92-79bf-4a14-84bb-fcd398b1f842 admin admin] PATH_INFO: `/v3/projects/698cdf0699114b5bb0c91325d3710a04/users/af32034741db488a88a92484ee071a30/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.042780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8305509eef149a8a286c00d32fff395', 'request_id': 'req-6a83e62e-f950-42a8-9fe1-007f1fd10876'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:35.044332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40b92-79bf-4a14-84bb-fcd398b1f842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698cdf0699114b5bb0c91325d3710a04, user_id=af32034741db488a88a92484ee071a30, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.047031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40b92-79bf-4a14-84bb-fcd398b1f842 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.055957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] The token cache is being invalidate because project b8305509eef149a8a286c00d32fff395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:35.056255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:35.056957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6a83e62e-f950-42a8-9fe1-007f1fd10876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:35.058515 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1257/2537] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:34 2022] DELETE /identity/v3/projects/b8305509eef149a8a286c00d32fff395 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:35.064435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9af839-fdc9-4610-bcf7-70c85bedb9f3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.065382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9af839-fdc9-4610-bcf7-70c85bedb9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.065664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9af839-fdc9-4610-bcf7-70c85bedb9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.085457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-eb9af839-fdc9-4610-bcf7-70c85bedb9f3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:35.086655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eb9af839-fdc9-4610-bcf7-70c85bedb9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:35.097645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1258/2538] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:35.111298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.112374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.112790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.133627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:35.134894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:35.147245 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1259/2539] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:35.148570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.152531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:35.159519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1281/2540] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:35 2022] PUT /identity/v3/projects/698cdf0699114b5bb0c91325d3710a04/users/af32034741db488a88a92484ee071a30/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:35.160722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d793-c702-4a4a-88f2-a9ffeb5efbef None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.172766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.173295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.179046 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.213414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] MFA Rules not processed for user `af32034741db488a88a92484ee071a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:35.214638 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:35.241341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.242030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.242288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.242567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.243233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:35.243541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.245181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.258351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1260/2541] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:12:35.262706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.272932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84345-ced6-4beb-a3c1-32909f0d15d2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.277619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.278216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.278492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.278765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.279390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.281312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.297218 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1282/2542] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:35.301488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.303014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:35.317765 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de3cd7-8000-4bb8-a230-502ba47b8e62 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.322399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.322998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.323277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.323552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.324205 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.326088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.431077 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1283/2543] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/projects => generated 401 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:35.431204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1261/2544] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:35.432843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.432983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.510288 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd0d4-0c13-4172-80d2-796e7c17fd1c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.511941 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee778a-031d-45d9-bdf4-e92ddf6ff9be admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.515318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.516145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.516645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.516970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.517448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.517851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.517985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.518286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.518633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.519441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.520468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.521403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.531196 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:35.647597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1284/2546] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/users => generated 307 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:35.650863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1262/2546] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:35.651705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.651890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.661752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26ee5-dca9-44fa-9ca5-62bfb04b7fa2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.664219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e052-93c8-45b3-b46e-998616705a85 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.667214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.667938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.668584 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.668986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.669655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.669837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.670414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.670689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.670989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.671310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.671599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.673304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.683349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1263/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:35.686020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1285/2548] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:35.687313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.691782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.700060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16d736-08ad-4ca1-bb9e-0a329f4534a6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.703149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301987c-1398-4653-96be-7909a9f58fb5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.706469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.707278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.707633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.708035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] PATH_INFO: `/v3/projects/8002855954234e51b008f41050d8be30/users/225f8e1d977e4ad0a5815e64272a0713/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.708760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.709527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.710017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.710544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.711576 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.714455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.728216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1286/2549] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:35.732909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.734968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8002855954234e51b008f41050d8be30, user_id=225f8e1d977e4ad0a5815e64272a0713, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.738833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.744325 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae67fd-6a79-41a1-9b59-303b1323b908 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.749060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69922686-abe1-4126-86c3-51c2b08b2131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.749783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69922686-abe1-4126-86c3-51c2b08b2131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.750121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69922686-abe1-4126-86c3-51c2b08b2131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.750397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69922686-abe1-4126-86c3-51c2b08b2131 admin admin] PATH_INFO: `/v3/projects/564eea74993c4f80813fe60a427d1749/users/6300c1d95c624a94a6dd44a0284aaf53/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.766199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69922686-abe1-4126-86c3-51c2b08b2131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=564eea74993c4f80813fe60a427d1749, user_id=6300c1d95c624a94a6dd44a0284aaf53, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.769999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69922686-abe1-4126-86c3-51c2b08b2131 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.803988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1264/2550] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:35 2022] PUT /identity/v3/projects/8002855954234e51b008f41050d8be30/users/225f8e1d977e4ad0a5815e64272a0713/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:35.807900 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.860500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1287/2551] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:35 2022] PUT /identity/v3/projects/564eea74993c4f80813fe60a427d1749/users/6300c1d95c624a94a6dd44a0284aaf53/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:35.870919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03bfeb-f398-446c-add9-af316d423f96 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.872144 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.872469 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.872749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.897485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:35.906698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] MFA Rules not processed for user `6300c1d95c624a94a6dd44a0284aaf53`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:35.907902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:35.933324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.933932 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.934214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.934485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.935130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.936755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.954952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1265/2552] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:35.957815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:35.970004 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b9ce6-a84e-4718-9ea6-9419c24b738e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:35.974804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5812d68-b6da-41ab-8cb7-6c4cfa46addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:35.979707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812d68-b6da-41ab-8cb7-6c4cfa46addd admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:35.979707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812d68-b6da-41ab-8cb7-6c4cfa46addd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:35.979707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812d68-b6da-41ab-8cb7-6c4cfa46addd admin admin] PATH_INFO: `/v3/projects/8002855954234e51b008f41050d8be30/users/225f8e1d977e4ad0a5815e64272a0713/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:35.979707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5812d68-b6da-41ab-8cb7-6c4cfa46addd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8002855954234e51b008f41050d8be30, user_id=225f8e1d977e4ad0a5815e64272a0713, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:35.981151 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5812d68-b6da-41ab-8cb7-6c4cfa46addd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:35.984121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1288/2553] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:35.995556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:36.000821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1266/2554] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:35 2022] PUT /identity/v3/projects/8002855954234e51b008f41050d8be30/users/225f8e1d977e4ad0a5815e64272a0713/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:36.000944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:36.010394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:36.010722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:36.011008 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:36.054222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] MFA Rules not processed for user `225f8e1d977e4ad0a5815e64272a0713`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:36.055477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:36.063948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a5315-f141-4038-a3ed-5707365b79e8 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:36.105516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:36.123055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:36.123834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:36.124614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:36.124614 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:36.149175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1267/2555] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:36.161602 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:36.163206 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:36.190074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:36.191738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:36.201833 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1289/2556] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:36.234727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc5e06-9129-4368-b7c0-8328fa89ba6f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:36.239397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:36.240233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:36.240636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:36.240985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:36.250787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:36.252715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:36.263752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1268/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:36.486017 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:36.495783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595a48-7c84-4ead-8907-31eec8c82c0a service glance] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:36.499399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa96ba-7d00-44e6-b004-f4e5bc4375d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:36.504632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa96ba-7d00-44e6-b004-f4e5bc4375d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:36.504632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa96ba-7d00-44e6-b004-f4e5bc4375d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:36.504632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa96ba-7d00-44e6-b004-f4e5bc4375d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:36.506773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:36.558837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa96ba-7d00-44e6-b004-f4e5bc4375d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:36.560317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa96ba-7d00-44e6-b004-f4e5bc4375d0 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:36.571115 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1290/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:41.646283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:41.712803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a346201-5e98-45dc-b316-97b4e62fad4f service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:41.717540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:41.718177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:41.718456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:41.718732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] PATH_INFO: `/v3/users/af32034741db488a88a92484ee071a30` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:41.719852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=af32034741db488a88a92484ee071a30)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:41.721881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:41.926214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af32034741db488a88a92484ee071a30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:42.065787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af32034741db488a88a92484ee071a30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:42.066464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af32034741db488a88a92484ee071a30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:42.067142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af32034741db488a88a92484ee071a30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:42.081902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af32034741db488a88a92484ee071a30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:42.092881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:42.101728 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1269/2559] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:41 2022] DELETE /identity/v3/users/af32034741db488a88a92484ee071a30 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:42.106595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:42.107064 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:42.107159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:42.126849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:42.128176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:42.193008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1291/2560] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:42.203278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:42.204678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:42.264398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c99ced-cc4f-46d8-90c2-099c73e33aef admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:42.268030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:42.268697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:42.268996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:42.269360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:42.279563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:42.281044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:42.290575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1270/2561] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:42.906989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:42.908575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:42.938852 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95955e-b40b-42e2-8613-8623525160ac None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:42.954672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:42.955520 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:42.956005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:42.956461 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] PATH_INFO: `/v3/projects/698cdf0699114b5bb0c91325d3710a04` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:42.957777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=698cdf0699114b5bb0c91325d3710a04)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:42.961200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:43.121654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698cdf0699114b5bb0c91325d3710a04', 'request_id': 'req-0446498b-4324-4048-a104-74408dfdf09c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.128784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698cdf0699114b5bb0c91325d3710a04', 'request_id': 'req-0446498b-4324-4048-a104-74408dfdf09c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.185778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698cdf0699114b5bb0c91325d3710a04', 'request_id': 'req-0446498b-4324-4048-a104-74408dfdf09c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.199681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] The token cache is being invalidate because project 698cdf0699114b5bb0c91325d3710a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:43.200060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.200873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.202710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1292/2562] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:42 2022] DELETE /identity/v3/projects/698cdf0699114b5bb0c91325d3710a04 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:43.206480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:43.220671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7e263-41d7-40e9-80e1-384657f0f373 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:43.290784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:43.291413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:43.291692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:43.291964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] PATH_INFO: `/v3/users/225f8e1d977e4ad0a5815e64272a0713` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:43.293205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225f8e1d977e4ad0a5815e64272a0713)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:43.295448 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:43.558407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225f8e1d977e4ad0a5815e64272a0713'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.675547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225f8e1d977e4ad0a5815e64272a0713'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.679085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225f8e1d977e4ad0a5815e64272a0713'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.679085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225f8e1d977e4ad0a5815e64272a0713'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.686559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25c9f152-c314-48dc-beec-508aa989dd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225f8e1d977e4ad0a5815e64272a0713'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:43.705929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1271/2563] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:43 2022] DELETE /identity/v3/users/225f8e1d977e4ad0a5815e64272a0713 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:44.142819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:44.144838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:44.159650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446498b-4324-4048-a104-74408dfdf09c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:44.201605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:44.230955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:44.231590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:44.231874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:44.232152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] PATH_INFO: `/v3/projects/8002855954234e51b008f41050d8be30` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:44.234432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8002855954234e51b008f41050d8be30)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:44.237907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:44.354430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8002855954234e51b008f41050d8be30', 'request_id': 'req-01484326-f5be-491e-8210-457da6372fcd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:44.363875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8002855954234e51b008f41050d8be30', 'request_id': 'req-01484326-f5be-491e-8210-457da6372fcd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:44.447412 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8002855954234e51b008f41050d8be30', 'request_id': 'req-01484326-f5be-491e-8210-457da6372fcd'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:44.468011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] The token cache is being invalidate because project 8002855954234e51b008f41050d8be30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:44.468608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:44.476533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-01484326-f5be-491e-8210-457da6372fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:44.478705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1293/2564] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:44 2022] DELETE /identity/v3/projects/8002855954234e51b008f41050d8be30 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:44.483582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:44.484111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:44.484234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:44.513745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:44.515010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:44.533199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:44.591785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1272/2565] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:44.599889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:44.600552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:44.600835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:44.621459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:44.622865 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:44.631660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1294/2566] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:44.641616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:44.652361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290769-056d-4653-8cce-7d9c13e34488 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:44.659108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:44.660001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:44.660538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:44.661188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:44.662144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:44.663348 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:44.665716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:44.697823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1273/2567] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:44.702550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:44.715872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f272397-3899-4c76-b608-2b7805614dcf None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:44.732750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:44.733389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:44.733674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:44.733949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:44.735182 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:44.737176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:44.850684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1295/2568] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:44 2022] POST /identity/v3/projects => generated 407 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:44.854979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:44.866216 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c171-439a-468d-bdf9-bc07dcda0865 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:44.928873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:44.929529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:44.929822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:44.930099 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:44.930744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:44.932723 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.050749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1274/2569] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:44 2022] POST /identity/v3/users => generated 304 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:45.058929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.064716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca0e1-fb65-4ef2-981c-358a396b96dc admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.070819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.071443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.071733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.072006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.072694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.074279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.091643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1296/2570] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:45.098845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.111003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e536d-091e-4403-8c4a-a899491dc611 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.116814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e1d29-b0d8-40cd-936b-47f6571a28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.117440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e1d29-b0d8-40cd-936b-47f6571a28b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.117732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e1d29-b0d8-40cd-936b-47f6571a28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.118241 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e1d29-b0d8-40cd-936b-47f6571a28b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.118880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e1d29-b0d8-40cd-936b-47f6571a28b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.120737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e1d29-b0d8-40cd-936b-47f6571a28b2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.132556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1275/2571] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:45.136824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.147334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fae77-bb0b-4f08-bcde-956e6946bc21 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.152241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.153023 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.153460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.153803 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] PATH_INFO: `/v3/projects/7490e0608bef4d75b63463af494a16c1/users/0eeec4e12a484fd981816f835cedfd25/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.174539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7490e0608bef4d75b63463af494a16c1, user_id=0eeec4e12a484fd981816f835cedfd25, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.177473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.241925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1297/2572] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:45 2022] PUT /identity/v3/projects/7490e0608bef4d75b63463af494a16c1/users/0eeec4e12a484fd981816f835cedfd25/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:45.253839 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.254347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.254617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.286738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] MFA Rules not processed for user `0eeec4e12a484fd981816f835cedfd25`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:45.288043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:45.359503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1276/2573] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:45.363957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.431653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:45.435340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799be28-038f-4466-ba27-3ace1a314031 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.440145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.440781 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.441074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.441358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.442011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.443988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.545423 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1298/2574] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:45 2022] POST /identity/v3/projects => generated 407 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:45.546802 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.558259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04eea0-8a4c-49ce-9e9c-0c50ddee7f97 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.568744 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:45.625090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.625698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.625994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.626246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.626874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.628811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.706282 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1277/2575] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:45 2022] POST /identity/v3/users => generated 310 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:45.710939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.721240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba119b-d395-4023-9ddb-29b4491885a8 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.727343 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.727977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.728262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.733166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.733166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.733166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.740936 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1299/2576] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:45.744831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.755022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1b328-a0d4-4a1f-a58d-775d51afa308 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.759896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.760665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.760951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.761226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] PATH_INFO: `/v3/projects/5d317f52be024d6ead55a773499056a5/users/4b2949cff0f4404895eba3f452820bce/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.777312 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d317f52be024d6ead55a773499056a5, user_id=4b2949cff0f4404895eba3f452820bce, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.780088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.901352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1278/2577] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:45 2022] PUT /identity/v3/projects/5d317f52be024d6ead55a773499056a5/users/4b2949cff0f4404895eba3f452820bce/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:45.905542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:45.915641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108483e-eb94-4737-be8c-006163b07945 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:45.977715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db256da-ee85-4b91-97fb-6ae340cc09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:45.978322 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db256da-ee85-4b91-97fb-6ae340cc09c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:45.978607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db256da-ee85-4b91-97fb-6ae340cc09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:45.978917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db256da-ee85-4b91-97fb-6ae340cc09c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:45.979541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db256da-ee85-4b91-97fb-6ae340cc09c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:45.981176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db256da-ee85-4b91-97fb-6ae340cc09c7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:45.991746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1300/2578] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:45.996366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:46.008239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558443b-529b-475d-a5cf-3d5fef80211a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:46.013069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:46.013713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:46.013994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:46.014275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] PATH_INFO: `/v3/projects/5d317f52be024d6ead55a773499056a5/users/4b2949cff0f4404895eba3f452820bce/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:46.016276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d317f52be024d6ead55a773499056a5, user_id=4b2949cff0f4404895eba3f452820bce, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:46.019355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:46.030727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1279/2579] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:45 2022] PUT /identity/v3/projects/5d317f52be024d6ead55a773499056a5/users/4b2949cff0f4404895eba3f452820bce/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:46.042837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:46.043142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:46.043391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:46.071507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] MFA Rules not processed for user `4b2949cff0f4404895eba3f452820bce`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:46.072798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:46.147680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1301/2580] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:46 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:46.158855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:46.160637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:46.223960 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514a903-c41c-49c8-a584-779c0175a5e0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:46.228378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:46.228999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:46.229268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:46.229572 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:46.239675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:46.242176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:46.253198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1280/2581] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:46 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:46.628179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:46.638389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b060f7-0243-4c58-a92d-e27ab350f6c3 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:46.642951 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:46.643753 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:46.644072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:46.644371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:46.700821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:46.709999 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:46.711458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:46.721603 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1302/2582] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:46 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:48.377911 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:48.379591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:48.437992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c8ca1-6bc8-482c-9a8b-c231e6565fdb service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:48.441583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:48.442188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:48.442476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:48.442753 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:48.445048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:48.464789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:48.510674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:48.512106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:48.522458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1281/2583] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:52.369438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:52.371014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:52.396341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb292-018b-4829-be0b-7e2bd80465d8 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:52.401615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:52.402313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:52.402515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:52.402792 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] PATH_INFO: `/v3/users/39133da0b7e049f09431c6e3d015f567` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:52.405153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39133da0b7e049f09431c6e3d015f567)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:52.407123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:52.684464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39133da0b7e049f09431c6e3d015f567'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:52.779435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39133da0b7e049f09431c6e3d015f567'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:52.780254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39133da0b7e049f09431c6e3d015f567'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:52.781071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39133da0b7e049f09431c6e3d015f567'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:52.790250 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-1aa03c38-b7db-4401-9cbc-8e21ba770a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39133da0b7e049f09431c6e3d015f567'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:52.812143 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1303/2584] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:52 2022] DELETE /identity/v3/users/39133da0b7e049f09431c6e3d015f567 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:53.094908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.106261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b1548-9013-441d-9ab9-ba53d786614f service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.169273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.169958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.170249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.170494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] PATH_INFO: `/v3/projects/025a7d4499644843aa3329355d0c6f99` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.171627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025a7d4499644843aa3329355d0c6f99)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.173592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.311016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025a7d4499644843aa3329355d0c6f99', 'request_id': 'req-0416052e-7d03-4db9-80b1-e51754e9f7f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:53.318604 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025a7d4499644843aa3329355d0c6f99', 'request_id': 'req-0416052e-7d03-4db9-80b1-e51754e9f7f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:53.373310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025a7d4499644843aa3329355d0c6f99', 'request_id': 'req-0416052e-7d03-4db9-80b1-e51754e9f7f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:53.385450 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] The token cache is being invalidate because project 025a7d4499644843aa3329355d0c6f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:53.385887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:53.386526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0416052e-7d03-4db9-80b1-e51754e9f7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:53.388404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1282/2585] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:53 2022] DELETE /identity/v3/projects/025a7d4499644843aa3329355d0c6f99 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:53.393879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.394357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.394514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.417014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:53.418345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:53.487233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1304/2586] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:53.496295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.496605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.496930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.516739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:53.517935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:53.526025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1283/2587] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:53.530275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.541073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56deb-ad6f-4270-87f2-a0ed787bd411 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.545726 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.546315 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.546629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.546913 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.547589 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:53.547887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.549486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.561914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1305/2588] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:53.566688 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.575925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de97077-9c95-453a-896c-c5a730ffc86e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.580552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.581139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.581413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.581680 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.582296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.584218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.706224 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1284/2589] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:53 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:53.711031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.720952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda53c1a-c384-40c8-a6ec-4b805cf8a263 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.768432 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:53.778609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.781361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.781361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.781361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.781361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.782396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.876868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1306/2590] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:53 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:53.881828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.895267 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320392-b282-430d-a324-a4979a8fa710 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.901116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.901848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.902263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.902398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.903063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.904685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.917697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1285/2591] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:53.928043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.929536 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.930532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:53.940086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305a73c-4f67-4e50-9c07-b8d7c5b7a9f9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.944068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceb309-6628-4228-bad8-99ae1fe3eb74 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.946407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.946407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.946407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.946917 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.947179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.948778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.950199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:53.959314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1286/2592] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:53.963136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.963744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.964027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.964301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] PATH_INFO: `/v3/users/0eeec4e12a484fd981816f835cedfd25` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.965314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:53.965470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eeec4e12a484fd981816f835cedfd25)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:53.967393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:53.976650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd993c-b029-4adc-b49b-8f8786e11f27 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:53.981481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0328b2-8a5e-48ae-835c-62558e438790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:53.982129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0328b2-8a5e-48ae-835c-62558e438790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:53.982419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0328b2-8a5e-48ae-835c-62558e438790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:53.982698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0328b2-8a5e-48ae-835c-62558e438790 admin admin] PATH_INFO: `/v3/projects/ac029c70a43e4fecb888d58c127fc42d/users/f72abcc5ddcd45d8874bdf350acbc246/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:53.997903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0328b2-8a5e-48ae-835c-62558e438790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac029c70a43e4fecb888d58c127fc42d, user_id=f72abcc5ddcd45d8874bdf350acbc246, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:54.000664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0328b2-8a5e-48ae-835c-62558e438790 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:54.111350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1287/2593] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:53 2022] PUT /identity/v3/projects/ac029c70a43e4fecb888d58c127fc42d/users/f72abcc5ddcd45d8874bdf350acbc246/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:54.121870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:54.122155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:54.122430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:54.151771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] MFA Rules not processed for user `f72abcc5ddcd45d8874bdf350acbc246`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:54.153139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:54.176529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eeec4e12a484fd981816f835cedfd25'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:54.229512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1288/2594] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:54.240950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:54.242095 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eeec4e12a484fd981816f835cedfd25'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:54.242426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:54.242743 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eeec4e12a484fd981816f835cedfd25'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:54.243362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eeec4e12a484fd981816f835cedfd25'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:54.251183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-05c64f1b-1ca0-4be8-9ad5-630982b85561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eeec4e12a484fd981816f835cedfd25'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:54.270042 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1307/2595] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:53 2022] DELETE /identity/v3/users/0eeec4e12a484fd981816f835cedfd25 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:54.275140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:54.275430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:54.275710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:54.295360 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:54.296608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:54.320622 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d39d5c-c2b1-4a0b-a951-b71b2146f384 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:54.361639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1308/2596] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:54.372204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:54.373604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:54.399035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:54.399765 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:54.400159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:54.400561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:54.404494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:54.433710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c61f1a-794f-498b-98ac-b0d5f1a38105 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:54.438689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:54.438689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:54.439059 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:54.439338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:54.449581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:54.451094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:54.460914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1309/2597] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:54.469369 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:54.471392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:54.482489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1289/2598] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:54.751684 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:54.941780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:54.943694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:54.977676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd697e-c2eb-4917-8b8d-4f446470927b service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:54.982430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:54.983071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:54.983346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:54.983622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] PATH_INFO: `/v3/projects/7490e0608bef4d75b63463af494a16c1` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:54.984875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7490e0608bef4d75b63463af494a16c1)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:54.986761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:55.030040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:55.030040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:55.047362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85460661-e23e-47fb-89e8-ff8f8f60265c service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:55.052026 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:55.052755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:55.053145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:55.053746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] PATH_INFO: `/v3/users/6300c1d95c624a94a6dd44a0284aaf53` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:55.054963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6300c1d95c624a94a6dd44a0284aaf53)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:55.056915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:55.073097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:55.117124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7490e0608bef4d75b63463af494a16c1', 'request_id': 'req-f3d68a77-3f3b-4548-b970-db7edee525d6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.123254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7490e0608bef4d75b63463af494a16c1', 'request_id': 'req-f3d68a77-3f3b-4548-b970-db7edee525d6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.184721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7490e0608bef4d75b63463af494a16c1', 'request_id': 'req-f3d68a77-3f3b-4548-b970-db7edee525d6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.196961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] The token cache is being invalidate because project 7490e0608bef4d75b63463af494a16c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:55.197346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.198045 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.199739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1310/2599] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:54 2022] DELETE /identity/v3/projects/7490e0608bef4d75b63463af494a16c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:55.203718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:55.205734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:55.225698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6300c1d95c624a94a6dd44a0284aaf53'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.282045 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6300c1d95c624a94a6dd44a0284aaf53'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.282767 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6300c1d95c624a94a6dd44a0284aaf53'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.283464 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6300c1d95c624a94a6dd44a0284aaf53'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.291717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66e5cc36-19a7-4a85-9d13-665e75d6662b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6300c1d95c624a94a6dd44a0284aaf53'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.318359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68a77-3f3b-4548-b970-db7edee525d6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:55.323443 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:55.324072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:55.324375 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:55.324714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] PATH_INFO: `/v3/users/4b2949cff0f4404895eba3f452820bce` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:55.325897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2949cff0f4404895eba3f452820bce)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:55.326345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1290/2600] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:55 2022] DELETE /identity/v3/users/6300c1d95c624a94a6dd44a0284aaf53 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:55.327858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:55.331185 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:55.331475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:55.331760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:55.357509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:55.359009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:55.419681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1291/2601] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:55.429366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:55.430740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:55.472092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:55.489493 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ea6c-e2e0-4e9d-9222-a5362841ccc5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:55.493303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:55.493915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:55.494194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:55.494469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:55.503462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:55.504928 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:55.514397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1292/2602] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:55.537255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2949cff0f4404895eba3f452820bce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.619256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2949cff0f4404895eba3f452820bce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.619887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2949cff0f4404895eba3f452820bce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.620512 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2949cff0f4404895eba3f452820bce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.627927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2949cff0f4404895eba3f452820bce'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:55.640931 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:55.645908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1311/2603] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:55 2022] DELETE /identity/v3/users/4b2949cff0f4404895eba3f452820bce => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:55.991957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:55.993499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:56.013306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a86d96-185b-4d05-bb56-ef5e9c14405f service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.083414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.084156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.085088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.085432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] PATH_INFO: `/v3/projects/564eea74993c4f80813fe60a427d1749` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.086620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564eea74993c4f80813fe60a427d1749)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.088524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.165233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.169891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:56.181100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79321a2e-32a7-4b8a-bf14-bb4e17778a79 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.185943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.186595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.186877 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.187152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] PATH_INFO: `/v3/projects/5d317f52be024d6ead55a773499056a5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.188333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d317f52be024d6ead55a773499056a5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.193304 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.212684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564eea74993c4f80813fe60a427d1749', 'request_id': 'req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.220883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564eea74993c4f80813fe60a427d1749', 'request_id': 'req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.314759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564eea74993c4f80813fe60a427d1749', 'request_id': 'req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.338360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] The token cache is being invalidate because project 564eea74993c4f80813fe60a427d1749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:56.338694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.339923 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-020ef6e5-8df7-4246-951a-bed1c1e1d2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.345433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1293/2604] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:55 2022] DELETE /identity/v3/projects/564eea74993c4f80813fe60a427d1749 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:56.347483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2962-abb1-4904-b2e3-70368342b35a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.347483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2962-abb1-4904-b2e3-70368342b35a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.347483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2962-abb1-4904-b2e3-70368342b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.363586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d317f52be024d6ead55a773499056a5', 'request_id': 'req-abae23ff-3207-49a6-9a57-757b64ae60eb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.370009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-af3e2962-abb1-4904-b2e3-70368342b35a None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:56.374443 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-af3e2962-abb1-4904-b2e3-70368342b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:56.375425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d317f52be024d6ead55a773499056a5', 'request_id': 'req-abae23ff-3207-49a6-9a57-757b64ae60eb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.422996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:56.448934 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d317f52be024d6ead55a773499056a5', 'request_id': 'req-abae23ff-3207-49a6-9a57-757b64ae60eb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.451014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1294/2605] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:56.457926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.458212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.458490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.467118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] The token cache is being invalidate because project 5d317f52be024d6ead55a773499056a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:56.467636 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.469722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-abae23ff-3207-49a6-9a57-757b64ae60eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:56.471645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1312/2606] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:56 2022] DELETE /identity/v3/projects/5d317f52be024d6ead55a773499056a5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:56.477630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309340b-e10a-4630-ad78-17407002e75b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.478099 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309340b-e10a-4630-ad78-17407002e75b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.478515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309340b-e10a-4630-ad78-17407002e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.483597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:56.484887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:56.494516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1295/2607] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:56.498791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.501643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3309340b-e10a-4630-ad78-17407002e75b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:56.502850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3309340b-e10a-4630-ad78-17407002e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:56.509309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35fd99-ed21-4002-ab7f-86e06d11e6e0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.512898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1313/2608] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:56.522420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.522768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.523308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.523773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.524805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.525307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.525842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.527042 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:56.527661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.536209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.544862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:56.546066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:56.546269 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1296/2609] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:12:56.550295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.554987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1314/2610] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:56.560725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb53cc-c1b1-4eac-b24b-7dd6ac5df545 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.562291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.565926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.566777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.567137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.567422 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.568050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.570773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.573002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c962f-b5a2-4631-bb85-277ffc812e9f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.578413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.579043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.579323 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.579595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.580241 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:56.580574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.582154 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.594998 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1315/2611] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:12:56.599251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.609212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0843-a4fe-46f1-9bd7-a751bebddafd admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.614047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.614634 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.614914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.615192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.615892 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.617808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.714998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1297/2612] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:56.720889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.752906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1316/2613] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:56.758555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.802625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2471-ac63-4e1c-ab90-638cd6a14489 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.830280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f89f0-cfaa-405b-9e93-cf9e57c002c3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.835297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.835940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.836223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.836545 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.837175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.839109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.860322 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.861027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.861308 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.861588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.862237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.864226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.946899 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1317/2614] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:56.951008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.960685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965769da-56d2-4cf7-af19-b4c2eaacffcb admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.966490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.967032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.967307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.967593 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.968276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.972889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1298/2615] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:56 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:12:56.973035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.974014 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.983389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1318/2616] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:56.984169 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a0b4-8590-4d0a-8fdb-bf083a6d00f7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:56.985158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:56.988938 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:56.989561 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:56.989837 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:56.990110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:56.991488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:56.993127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:56.996471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46288a3c-88fd-4372-b925-590a70f62c3c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.002058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.002799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.003056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.003335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.003468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1299/2617] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:57.003970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.005729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.008009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.012738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:57.017820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146972-61f6-4a28-80e6-0f4fc6c88af2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.022994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1319/2618] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:12:57.023357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.023357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.023544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.023716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.024012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.024386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.025952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.034605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5196d-7ae9-4abe-b1fe-87a6e7983639 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.037754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1300/2619] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:57.040198 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee2d3b-ae04-4391-937f-678e3a3d241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.042823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.043755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee2d3b-ae04-4391-937f-678e3a3d241d admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.044042 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee2d3b-ae04-4391-937f-678e3a3d241d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.044333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee2d3b-ae04-4391-937f-678e3a3d241d admin admin] PATH_INFO: `/v3/projects/5c97170acadf476e9cbec117ef512d5f/users/06d3ad6059a84df1879d74025457816b/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.052849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6d518-a4b7-41da-adae-6b0a1dcf76fa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.058209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb731a06-bf26-4486-bf04-1a9e0c1cf93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.058899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb731a06-bf26-4486-bf04-1a9e0c1cf93e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.059195 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb731a06-bf26-4486-bf04-1a9e0c1cf93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.059462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb731a06-bf26-4486-bf04-1a9e0c1cf93e admin admin] PATH_INFO: `/v3/projects/8891e4522c554d29b93a5425b318bca7/users/c9b84b1c7d4f43dca8d66a8072b16e21/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.069510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee2d3b-ae04-4391-937f-678e3a3d241d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c97170acadf476e9cbec117ef512d5f, user_id=06d3ad6059a84df1879d74025457816b, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.072208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee2d3b-ae04-4391-937f-678e3a3d241d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.075294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb731a06-bf26-4486-bf04-1a9e0c1cf93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8891e4522c554d29b93a5425b318bca7, user_id=c9b84b1c7d4f43dca8d66a8072b16e21, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.077949 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb731a06-bf26-4486-bf04-1a9e0c1cf93e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.150748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1320/2620] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:57 2022] PUT /identity/v3/projects/5c97170acadf476e9cbec117ef512d5f/users/06d3ad6059a84df1879d74025457816b/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:57.151725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1301/2621] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:57 2022] PUT /identity/v3/projects/8891e4522c554d29b93a5425b318bca7/users/c9b84b1c7d4f43dca8d66a8072b16e21/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:57.161567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.161963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.162303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.163344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.163846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.164236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.191493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] MFA Rules not processed for user `06d3ad6059a84df1879d74025457816b`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:57.192015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] MFA Rules not processed for user `c9b84b1c7d4f43dca8d66a8072b16e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:57.192887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:57.193280 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:57.256440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1321/2622] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:57.258612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1302/2623] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:57.260830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.270703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.272383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:57.326668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2be1e-af14-4016-bd93-f718c03f0c16 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.331236 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.331844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.332122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.332422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.333066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.333833 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706180a-afd4-4234-bd0b-cb1826b3f69d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.335036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.338122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.338724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.339002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.339272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.347615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.349266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.360417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1303/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:57.431339 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1322/2625] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:57 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:57.435324 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.446370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf677ae3-13e6-42cc-a56e-99e386daea78 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.488661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:57.510492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.511092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.511374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.511646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.512276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.514299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.622588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1304/2626] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:57 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:57.623898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.634827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5b69-371e-48ff-a64f-98959b28cfcf admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.639717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.642083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.642083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.642083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.642083 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.643190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.653734 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1323/2627] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:57.657909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.668891 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e46c-894b-47f6-8b56-1ce759d9dbcb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.673678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.674326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.674608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.674887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] PATH_INFO: `/v3/projects/30bffb96d808493199ab065c8777ed51/users/1af2603b4d4047748f60455a03ffee40/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.689725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bffb96d808493199ab065c8777ed51, user_id=1af2603b4d4047748f60455a03ffee40, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.692522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.771019 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1305/2628] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:57 2022] PUT /identity/v3/projects/30bffb96d808493199ab065c8777ed51/users/1af2603b4d4047748f60455a03ffee40/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:57.772425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.782667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4997-f0ce-49ab-a9f9-b01b99ee8bb5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.852186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.854262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:57.863209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.863954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.864280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.864835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.865880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.867293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.882648 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1324/2629] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:12:57.885673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:57.896010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729207-54cc-4fad-82f8-798cf6ad782d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.903096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b12411-369f-4e1d-a736-3277e45e9714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:57.903867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b12411-369f-4e1d-a736-3277e45e9714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.904285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b12411-369f-4e1d-a736-3277e45e9714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.904624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b12411-369f-4e1d-a736-3277e45e9714 admin admin] PATH_INFO: `/v3/projects/30bffb96d808493199ab065c8777ed51/users/1af2603b4d4047748f60455a03ffee40/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.906882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b12411-369f-4e1d-a736-3277e45e9714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bffb96d808493199ab065c8777ed51, user_id=1af2603b4d4047748f60455a03ffee40, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:57.909834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b12411-369f-4e1d-a736-3277e45e9714 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:57.927702 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1325/2630] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:12:57 2022] PUT /identity/v3/projects/30bffb96d808493199ab065c8777ed51/users/1af2603b4d4047748f60455a03ffee40/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:12:57.969222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a476a-0654-4b98-afd0-aa691e72a40e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:57.969459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:57.969459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:57.969459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:57.973721 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] MFA Rules not processed for user `1af2603b4d4047748f60455a03ffee40`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:57.975227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:58.002724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:58.003356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:58.003804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:58.004092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] PATH_INFO: `/v3/users/f72abcc5ddcd45d8874bdf350acbc246` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:58.005276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72abcc5ddcd45d8874bdf350acbc246)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:58.008175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:58.049698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1326/2631] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:58.061468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:58.062272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:58.093399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:58.129496 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f01df0-6bf3-48c2-9d02-6ec35ec06dd4 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:58.133907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a921b-3a77-4e53-a6b5-81c2e2d0945f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:58.134467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a921b-3a77-4e53-a6b5-81c2e2d0945f service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:58.134779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a921b-3a77-4e53-a6b5-81c2e2d0945f service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:58.135055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a921b-3a77-4e53-a6b5-81c2e2d0945f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:58.144529 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a921b-3a77-4e53-a6b5-81c2e2d0945f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:58.146255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a921b-3a77-4e53-a6b5-81c2e2d0945f service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:58.156645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1327/2632] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:12:58.252194 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72abcc5ddcd45d8874bdf350acbc246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:58.265337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:58.365758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72abcc5ddcd45d8874bdf350acbc246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:58.366730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72abcc5ddcd45d8874bdf350acbc246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:58.367063 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72abcc5ddcd45d8874bdf350acbc246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:58.377652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72abcc5ddcd45d8874bdf350acbc246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:58.401577 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1306/2633] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:57 2022] DELETE /identity/v3/users/f72abcc5ddcd45d8874bdf350acbc246 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:58.405255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:58.405549 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:58.405834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:58.441774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:58.441774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:58.510351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1328/2634] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:58.526064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:58.526064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:58.612209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e6400-524c-4ed5-9c49-b07fe33e3a53 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:58.612209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:58.612835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:58.613121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:58.613398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:58.623338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:58.624850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:58.641022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1307/2635] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:58.743895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:58.792569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:58.793965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:58.805942 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af5c9b-143b-49d8-a801-e6cdda3d3d29 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:58.810635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:58.811259 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:58.811541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:58.811812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] PATH_INFO: `/v3/users/06d3ad6059a84df1879d74025457816b` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:58.812957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d3ad6059a84df1879d74025457816b)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:58.814866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:59.080803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:59.204066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d3ad6059a84df1879d74025457816b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.252978 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:59.254408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.267397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d3ad6059a84df1879d74025457816b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.268447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55edb-6212-4f53-98f0-c2005f6c607e service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:59.269248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d3ad6059a84df1879d74025457816b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.272599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d3ad6059a84df1879d74025457816b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.274922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:59.275693 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.276046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.276620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] PATH_INFO: `/v3/projects/ac029c70a43e4fecb888d58c127fc42d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.277717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac029c70a43e4fecb888d58c127fc42d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:59.279725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:59.283270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d76f144d-1145-4618-b6e7-5ad1d015f663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d3ad6059a84df1879d74025457816b'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.309075 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1329/2636] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:58 2022] DELETE /identity/v3/users/06d3ad6059a84df1879d74025457816b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:59.312033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.312366 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.312644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.333369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:59.334849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.390658 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac029c70a43e4fecb888d58c127fc42d', 'request_id': 'req-fd3af0b7-76b1-438e-9d20-e8e5f53de001'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.398278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac029c70a43e4fecb888d58c127fc42d', 'request_id': 'req-fd3af0b7-76b1-438e-9d20-e8e5f53de001'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.405649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1330/2637] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:59.406787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:59.408177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.426493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59fed8-4a7c-4743-8926-cc1f6b3f0827 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:59.476996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac029c70a43e4fecb888d58c127fc42d', 'request_id': 'req-fd3af0b7-76b1-438e-9d20-e8e5f53de001'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.482156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:59.482774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.483050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.483316 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] PATH_INFO: `/v3/users/a6059f5599da40d4b81439018bf34737` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.484448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6059f5599da40d4b81439018bf34737)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:59.486344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:59.487877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] The token cache is being invalidate because project ac029c70a43e4fecb888d58c127fc42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:12:59.488175 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.488846 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.490398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1308/2638] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:12:59 2022] DELETE /identity/v3/projects/ac029c70a43e4fecb888d58c127fc42d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:59.491979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:59.493236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.551072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af0b7-76b1-438e-9d20-e8e5f53de001 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:59.555391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:59.555995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.556328 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.556610 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.558332 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.570176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:59.571614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c562f1-4324-481b-a2c2-f64d9ce2cf84 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:59.580957 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1309/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:12:59.582258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40b80f-e5db-4de1-bb30-982d8a5ebbaf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.582553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40b80f-e5db-4de1-bb30-982d8a5ebbaf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.582838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40b80f-e5db-4de1-bb30-982d8a5ebbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.603699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3d40b80f-e5db-4de1-bb30-982d8a5ebbaf None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:59.604954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3d40b80f-e5db-4de1-bb30-982d8a5ebbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.613350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1310/2640] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:12:59.623251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.623503 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.623814 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.624807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:12:59.643618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:12:59.644826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.652823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1311/2641] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:12:59.657227 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:59.666491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c9099-9050-4720-b580-c6d6572ae310 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:59.671546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:59.672133 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.672436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.672710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.673376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:12:59.673673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:59.675281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:59.691259 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1312/2642] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:12:59.691850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6059f5599da40d4b81439018bf34737'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.692230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:59.706641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27c594-249b-433b-bf89-55d10e610158 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:12:59.712005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:12:59.714605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:12:59.714605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:12:59.714605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:12:59.714605 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:12:59.715686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:12:59.767591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6059f5599da40d4b81439018bf34737'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.768262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6059f5599da40d4b81439018bf34737'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.768925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6059f5599da40d4b81439018bf34737'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.777868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6059f5599da40d4b81439018bf34737'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:12:59.796471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1331/2643] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:12:59 2022] DELETE /identity/v3/users/a6059f5599da40d4b81439018bf34737 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:12:59.858529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1313/2644] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:12:59 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:12:59.862543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:12:59.864068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:12:59.943170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff6ab9-9271-4565-b3ce-b5ec6fb393c0 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.013483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.014088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.014371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.014651 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.015274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.017200 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.102086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.105857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:00.130780 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8458b-31eb-4906-a4d9-a430137103dc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.136477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.140576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.140963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.141722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] PATH_INFO: `/v3/projects/5c97170acadf476e9cbec117ef512d5f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.142735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c97170acadf476e9cbec117ef512d5f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.146892 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.151883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:00.158278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1332/2645] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:12:59 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:00.158278 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.160245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:00.172710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175e24-a8a6-45a9-8aec-edbe12c0648b admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.179072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.179929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.180215 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.180535 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] PATH_INFO: `/v3/projects/086e76b2cc8b47169ad4a0ec77f15b3f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.181733 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086e76b2cc8b47169ad4a0ec77f15b3f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.183748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.265005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c97170acadf476e9cbec117ef512d5f', 'request_id': 'req-5994c987-c340-424e-88c0-9733912f490a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.271275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c97170acadf476e9cbec117ef512d5f', 'request_id': 'req-5994c987-c340-424e-88c0-9733912f490a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.293493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086e76b2cc8b47169ad4a0ec77f15b3f', 'request_id': 'req-02d5918e-8614-4718-9b51-704b4c10a297'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.300020 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086e76b2cc8b47169ad4a0ec77f15b3f', 'request_id': 'req-02d5918e-8614-4718-9b51-704b4c10a297'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.368017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c97170acadf476e9cbec117ef512d5f', 'request_id': 'req-5994c987-c340-424e-88c0-9733912f490a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.379363 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] The token cache is being invalidate because project 5c97170acadf476e9cbec117ef512d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:00.379655 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.383313 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.384999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1314/2646] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:00 2022] DELETE /identity/v3/projects/5c97170acadf476e9cbec117ef512d5f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:00.385830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.387135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:00.452090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c987-c340-424e-88c0-9733912f490a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.470725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086e76b2cc8b47169ad4a0ec77f15b3f', 'request_id': 'req-02d5918e-8614-4718-9b51-704b4c10a297'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.483222 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] The token cache is being invalidate because project 086e76b2cc8b47169ad4a0ec77f15b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:00.483514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.484180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.485820 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1333/2647] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:00 2022] DELETE /identity/v3/projects/086e76b2cc8b47169ad4a0ec77f15b3f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:00.486628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.487872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:00.512513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.513126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.513408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.513682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.514320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.515984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.526544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1315/2648] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:00.530540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.530540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:00.543430 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d9e82-5bcd-4594-a4c0-e1b85011dd4a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.548030 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.548679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.548985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.549436 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] PATH_INFO: `/v3/users/48be5d256e724071ab345ab554afbbf5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.551140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48be5d256e724071ab345ab554afbbf5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.553192 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.555284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5918e-8614-4718-9b51-704b4c10a297 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.559987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.560642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.560904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.561197 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] PATH_INFO: `/v3/users/1af2603b4d4047748f60455a03ffee40` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.562310 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af2603b4d4047748f60455a03ffee40)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.564193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.753588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48be5d256e724071ab345ab554afbbf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.767659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:00.832541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af2603b4d4047748f60455a03ffee40'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.841999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48be5d256e724071ab345ab554afbbf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.845660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48be5d256e724071ab345ab554afbbf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.845660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48be5d256e724071ab345ab554afbbf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.851173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48be5d256e724071ab345ab554afbbf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.868535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1316/2649] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:00 2022] DELETE /identity/v3/users/48be5d256e724071ab345ab554afbbf5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:00.871576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.871576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:00.955187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75946b-c1ee-4012-bc99-eac1a62a3117 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:00.961178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:00.961804 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:00.962003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af2603b4d4047748f60455a03ffee40'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.962128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:00.962359 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:00.963011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:00.963672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af2603b4d4047748f60455a03ffee40'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.964502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af2603b4d4047748f60455a03ffee40'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.967278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:00.973675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af2603b4d4047748f60455a03ffee40'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:00.978805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1317/2650] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:00.982881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:00.985270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.005518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db1d4-e8c4-409d-9b6b-1881d056a583 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.007287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1334/2651] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:00 2022] DELETE /identity/v3/users/1af2603b4d4047748f60455a03ffee40 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:01.094374 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae753-e70b-4726-a17f-adf65b2e841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.095051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae753-e70b-4726-a17f-adf65b2e841f admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.095342 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae753-e70b-4726-a17f-adf65b2e841f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.095615 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae753-e70b-4726-a17f-adf65b2e841f admin admin] PATH_INFO: `/v3/projects/ba85d17b0a1242059e06a5f6488b42ea/users/b1a508029e8d4fa697cac69a224d4e30/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.113314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae753-e70b-4726-a17f-adf65b2e841f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba85d17b0a1242059e06a5f6488b42ea, user_id=b1a508029e8d4fa697cac69a224d4e30, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:01.115961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae753-e70b-4726-a17f-adf65b2e841f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:01.145720 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:01.159137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:01.159137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.191571 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a3b47-9e1b-4252-a2d6-8c5952e79adf admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.198076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.199167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.199579 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.199893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] PATH_INFO: `/v3/projects/4d20443dd3964307b804f69c2170ac12` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.201782 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d20443dd3964307b804f69c2170ac12)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:01.204344 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:01.211499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1318/2652] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:00 2022] PUT /identity/v3/projects/ba85d17b0a1242059e06a5f6488b42ea/users/b1a508029e8d4fa697cac69a224d4e30/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:01.222310 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.227333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.228005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.260866 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] MFA Rules not processed for user `b1a508029e8d4fa697cac69a224d4e30`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:01.262502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.366075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1319/2653] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:01.366797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d20443dd3964307b804f69c2170ac12', 'request_id': 'req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.367713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:01.383563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d20443dd3964307b804f69c2170ac12', 'request_id': 'req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.405955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:01.471283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f3550-3795-44a0-adba-ce16df2b0979 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.485076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d20443dd3964307b804f69c2170ac12', 'request_id': 'req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.498895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] The token cache is being invalidate because project 4d20443dd3964307b804f69c2170ac12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:01.499224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.499897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-3562b6e3-f45d-47e8-9ff6-95c2f2f28ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.501640 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1335/2654] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:01 2022] DELETE /identity/v3/projects/4d20443dd3964307b804f69c2170ac12 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:01.506224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.506525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.506831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.533087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:01.534378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.549593 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddb7a4-2c56-466f-b922-841dae173438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.550200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddb7a4-2c56-466f-b922-841dae173438 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.550480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddb7a4-2c56-466f-b922-841dae173438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.550750 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddb7a4-2c56-466f-b922-841dae173438 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.551379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddb7a4-2c56-466f-b922-841dae173438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:01.553307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddb7a4-2c56-466f-b922-841dae173438 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:01.616457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1336/2655] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:01.617662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:01.619862 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.634639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a9065-6317-4631-b886-d1b87e0c6361 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.640408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1320/2656] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:01 2022] POST /identity/v3/projects => generated 383 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:01.642260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.643006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.644903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.645928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.649074 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.649394 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.649657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] PATH_INFO: `/v3/projects/30bffb96d808493199ab065c8777ed51` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.650737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:01.653245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bffb96d808493199ab065c8777ed51)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:01.655552 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:01.670668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:01.672423 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.745006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1321/2657] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:01.746017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:01.747362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.760773 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef48b3a-e41a-46c0-981e-d3bd43d46df3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.767072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.767719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.767999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.768442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.769111 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:01.773153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:01.801671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bffb96d808493199ab065c8777ed51', 'request_id': 'req-c1628b58-364c-47ab-ae4d-34d908a7b230'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.810337 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bffb96d808493199ab065c8777ed51', 'request_id': 'req-c1628b58-364c-47ab-ae4d-34d908a7b230'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.877733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1322/2658] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:01 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:01.878588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:01.890233 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821fb16-6129-4ec3-8b2c-340d98c118e2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.905517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bffb96d808493199ab065c8777ed51', 'request_id': 'req-c1628b58-364c-47ab-ae4d-34d908a7b230'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.918695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] The token cache is being invalidate because project 30bffb96d808493199ab065c8777ed51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:01.918981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.919646 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:01.921212 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1337/2659] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:01 2022] DELETE /identity/v3/projects/30bffb96d808493199ab065c8777ed51 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:01.925578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:01.925578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:01.959273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:01.963266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.964336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.964880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.965391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.966619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:01.967189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:01.970416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0933a4-af85-4dd4-b7a3-8ddfe4e7ad9f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:01.984872 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1323/2660] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:13:01.986372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.986653 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.987489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.993466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1628b58-364c-47ab-ae4d-34d908a7b230 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:01.998122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:01.998722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:01.998997 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:01.999268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:01.999904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.001532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.008252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:02.009465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:02.012091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1338/2661] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:02.012853 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.014417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:02.020360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1324/2662] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:02.022816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.027622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409266e-046c-420f-b3f5-ffe3e79722f6 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.033855 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3e12-0c9d-4879-9aa0-7c29fcf742af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.034181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5557cf-d086-4813-86f2-ce071691bfb1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.034494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3e12-0c9d-4879-9aa0-7c29fcf742af admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.034834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3e12-0c9d-4879-9aa0-7c29fcf742af admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.035113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3e12-0c9d-4879-9aa0-7c29fcf742af admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.035760 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f3e12-0c9d-4879-9aa0-7c29fcf742af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.037923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f3e12-0c9d-4879-9aa0-7c29fcf742af admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.039756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.040462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.040742 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.041016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.041677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.043314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.059858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1325/2663] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:02.060988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.072553 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac42272-6344-43b8-b50a-3b90f563f07e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.077534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.078228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.078508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.078787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] PATH_INFO: `/v3/projects/77bc0f7cdf674957a2b38add3a1ab0e7/users/dce3218e82af4f66b0433d6a2060a89c/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.097020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bc0f7cdf674957a2b38add3a1ab0e7, user_id=dce3218e82af4f66b0433d6a2060a89c, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.100513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.116703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:02.169537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1339/2664] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:02.170689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ef42-2114-4f15-b219-d5e0df003e98 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.170980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ef42-2114-4f15-b219-d5e0df003e98 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.171255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ef42-2114-4f15-b219-d5e0df003e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.190837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-dcf4ef42-2114-4f15-b219-d5e0df003e98 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:02.192034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dcf4ef42-2114-4f15-b219-d5e0df003e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:02.200603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1326/2665] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:02 2022] PUT /identity/v3/projects/77bc0f7cdf674957a2b38add3a1ab0e7/users/dce3218e82af4f66b0433d6a2060a89c/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:02.201557 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.252003 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1340/2666] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:02.254272 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.254748 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.255229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.266522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78c754-a14b-452b-8848-60dfa55d109a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.271458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.272061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.272387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.272763 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.273478 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.275380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.285666 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] MFA Rules not processed for user `dce3218e82af4f66b0433d6a2060a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:02.286858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:02.351314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1327/2667] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:02.352085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1341/2668] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:02.352223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.355308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.356886 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:02.365917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d237-43bb-49d7-b9d1-f38551efaf44 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.367071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e59a6-8880-4d3d-89f8-096e67cc1c68 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.371110 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.371705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.371979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.372085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.372246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.372646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.372906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.373020 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.373184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.373821 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:02.374119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.374473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.375676 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.384613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1342/2669] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:02.386720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.388154 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1328/2670] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:13:02.389089 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.397950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341b13-c8b9-43dd-8d21-b1f5776d7044 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.398824 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55120c-dab5-4138-b745-9b7b2638c4f0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.402539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.403146 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.403427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.403708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.404866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.405303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.406248 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.406384 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.406547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.407301 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.407798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.409638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.424435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1329/2671] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:02.425471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.436947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8d86-f294-465a-85ba-6fc7eef63187 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.442242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.442355 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.442636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.442913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.443541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.445623 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.521192 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:02.527717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1343/2672] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:02.530338 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.589326 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1330/2673] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:02.590122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf013a68-86b0-4e07-b35e-f12cfc7ac2f7 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.590367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.648610 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.649264 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.649539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.649810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] PATH_INFO: `/v3/projects/ac7a1da3e1b34c45821edfe2a862e47a/users/8be65f00988d4f6499da5f46ea9a5e9e/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.655092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc5f0-408a-4856-a795-b822a7b1df19 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.659963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.660670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.660953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.661230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.661855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.664855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.670672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7a1da3e1b34c45821edfe2a862e47a, user_id=8be65f00988d4f6499da5f46ea9a5e9e, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.673410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.765056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1331/2674] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:02.765269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1344/2675] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:02 2022] PUT /identity/v3/projects/ac7a1da3e1b34c45821edfe2a862e47a/users/8be65f00988d4f6499da5f46ea9a5e9e/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:02.765383 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.773025 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ec501-b767-4206-81ee-862ac7ba7896 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.773245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.832741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.833541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.833873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.838524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.838524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.838524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.839827 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d820178-b97d-4d65-b40d-af15b627bd5e admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.844916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a08c0-caf2-4ed6-b0d0-e818932ac641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.845637 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a08c0-caf2-4ed6-b0d0-e818932ac641 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.845927 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a08c0-caf2-4ed6-b0d0-e818932ac641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.846201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a08c0-caf2-4ed6-b0d0-e818932ac641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.847605 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a08c0-caf2-4ed6-b0d0-e818932ac641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.848514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a08c0-caf2-4ed6-b0d0-e818932ac641 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.860757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1345/2676] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:02.862203 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.862517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.862790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.891158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] MFA Rules not processed for user `8be65f00988d4f6499da5f46ea9a5e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:02.892396 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:02.948262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1332/2677] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:02.948262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.957219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd9056-7410-4b3c-9fd1-f02aff28a3df admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.957771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1346/2678] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:02.958635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:02.966884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.970487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.970487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.970487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] PATH_INFO: `/v3/projects/95c708a1faba422683e232d8c4e01972/users/7d6e1c489b484d9b88dd9aaa77f01a06/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.972712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5e0bd-2083-4bc2-ae54-7b65ae713eae None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:02.978713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:02.979453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:02.979784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:02.980062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:02.980778 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.982500 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.983847 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c708a1faba422683e232d8c4e01972, user_id=7d6e1c489b484d9b88dd9aaa77f01a06, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:02.986627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:02.993635 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1347/2679] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:02.996706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.003644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413486e9-ee37-4718-98cc-3ed2f047a841 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.008458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.009033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.009307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.009590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.010229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.012030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.088140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1333/2680] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:02 2022] PUT /identity/v3/projects/95c708a1faba422683e232d8c4e01972/users/7d6e1c489b484d9b88dd9aaa77f01a06/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:03.089067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.098979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:03.100902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:03.108142 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1348/2681] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:02 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:03.108986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.154784 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad398f8-ad7d-492a-ba45-3310176034b2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.171586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ba6a-fe1a-49a7-ab94-15f913b13b59 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.176467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.180518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.180518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.180518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.180518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.180518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.190830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1349/2682] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:03.191632 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.202800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040408e4-6fa9-4a56-a160-1828024829f8 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.207641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af74b2b-46c6-4f2b-8edf-b40552be8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.208230 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af74b2b-46c6-4f2b-8edf-b40552be8fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.208573 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af74b2b-46c6-4f2b-8edf-b40552be8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.208824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af74b2b-46c6-4f2b-8edf-b40552be8fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.209446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af74b2b-46c6-4f2b-8edf-b40552be8fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.211715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af74b2b-46c6-4f2b-8edf-b40552be8fb9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.214958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.215686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.215983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.216284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.217037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.218876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.230668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1334/2683] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:03.231595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.241929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef259c6f-564b-44bf-ac44-78ab22403bab admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.246527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.247150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.247426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.247700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] PATH_INFO: `/v3/projects/95c708a1faba422683e232d8c4e01972/users/7d6e1c489b484d9b88dd9aaa77f01a06/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.249612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c708a1faba422683e232d8c4e01972, user_id=7d6e1c489b484d9b88dd9aaa77f01a06, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.254834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.262037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1335/2684] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:03 2022] PUT /identity/v3/projects/95c708a1faba422683e232d8c4e01972/users/7d6e1c489b484d9b88dd9aaa77f01a06/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:03.263540 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.326433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256b7ad-c80a-4b32-9a78-232c28eceae7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.332390 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eae220-58b3-4d33-a58b-741532994258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.333074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eae220-58b3-4d33-a58b-741532994258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.333360 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eae220-58b3-4d33-a58b-741532994258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.336691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1350/2685] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:03 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:03.336858 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eae220-58b3-4d33-a58b-741532994258 admin admin] PATH_INFO: `/v3/projects/2e9bbe52c5694bb0b26619508c3c5e81/users/f2c725a5e46c4849bdbd506e3b086fad/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.336981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.336981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.336981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.348811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eae220-58b3-4d33-a58b-741532994258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9bbe52c5694bb0b26619508c3c5e81, user_id=f2c725a5e46c4849bdbd506e3b086fad, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.352684 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eae220-58b3-4d33-a58b-741532994258 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.364948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] MFA Rules not processed for user `7d6e1c489b484d9b88dd9aaa77f01a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:03.366949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:03.416130 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:03.436783 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1351/2686] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:03.437218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1336/2687] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:03 2022] PUT /identity/v3/projects/2e9bbe52c5694bb0b26619508c3c5e81/users/f2c725a5e46c4849bdbd506e3b086fad/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:03.441570 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.447677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ebb4-d17e-4b43-970b-fd6393e1788e None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.449652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.449977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.450262 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.481015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] MFA Rules not processed for user `f2c725a5e46c4849bdbd506e3b086fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:03.482315 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:03.492648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:03.506699 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.508015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.508293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.508604 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.509308 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.510902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.521148 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1352/2688] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:03.522121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.525058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:03.550909 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1337/2689] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:03.561754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.562958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc930095-e18a-40c0-978a-f3e1cd7c0b04 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.567454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.568097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.568409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.568681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] PATH_INFO: `/v3/projects/dd372fb0c6d04f719587538482772162/users/fd895193b8fb4318891078768d285e93/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.588179 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd372fb0c6d04f719587538482772162, user_id=fd895193b8fb4318891078768d285e93, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.588376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35f80-3f6b-4c5a-bf84-aa2b39f479bd admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.588507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.590478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.591159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.591508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.591916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.656335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.657984 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.667296 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1353/2690] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:03.668060 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.670986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1338/2691] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:03 2022] PUT /identity/v3/projects/dd372fb0c6d04f719587538482772162/users/fd895193b8fb4318891078768d285e93/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:03.675140 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.682204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40fdb-1a95-485a-bc72-48da105fa71f service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.718977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:03.750168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352795-7a32-4535-8e82-cb2a54a6a53b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.759930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.760651 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.761781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.761781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.762250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.763852 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.767629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.768615 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.769152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.769506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.770378 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.773010 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.776344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1339/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:03.781489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.798717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1dca-93e9-4ff3-bc96-4e7ed1c608d3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.804984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda3f9-597a-4130-9437-9b7b34428a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.805798 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda3f9-597a-4130-9437-9b7b34428a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.806161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda3f9-597a-4130-9437-9b7b34428a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.806574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda3f9-597a-4130-9437-9b7b34428a27 admin admin] PATH_INFO: `/v3/projects/dd372fb0c6d04f719587538482772162/users/fd895193b8fb4318891078768d285e93/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.809611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacda3f9-597a-4130-9437-9b7b34428a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd372fb0c6d04f719587538482772162, user_id=fd895193b8fb4318891078768d285e93, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.814794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacda3f9-597a-4130-9437-9b7b34428a27 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.826057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1340/2693] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:03 2022] PUT /identity/v3/projects/dd372fb0c6d04f719587538482772162/users/fd895193b8fb4318891078768d285e93/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:03.836180 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.837285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.837285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.864089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1354/2694] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:03 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:03.872034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.872173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] MFA Rules not processed for user `fd895193b8fb4318891078768d285e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:03.872173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:03.934975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca211-a601-48e7-ac45-48315926ce26 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:03.941019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:03.941629 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:03.941909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:03.942183 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:03.942814 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:03.945101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:03.947235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:03.958689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1341/2695] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:03.969391 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:03.971013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:04.033384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae2c90-af7b-4ae0-a177-78cf76d48d56 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.037144 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.037762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.038570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.038868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.086247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1355/2696] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:03 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:04.090269 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:04.095521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:04.096989 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:04.100858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5368f8-5075-434d-bfc8-3b8df96f2ff5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.105729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.107091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.107091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.107091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.107361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1342/2697] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:04.107601 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:04.109305 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:04.123697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1356/2698] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:04.128054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:04.141102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44ed80-e130-4953-b7e4-e5b4fcdfc98c service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.146748 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.148407 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.148749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.149065 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] PATH_INFO: `/v3/projects/01514d791f8d44178943f898271367b1/users/35924026d24846deac786849ecd4d20f/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.165316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01514d791f8d44178943f898271367b1, user_id=35924026d24846deac786849ecd4d20f, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:04.168085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:04.242691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1343/2699] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:04 2022] PUT /identity/v3/projects/01514d791f8d44178943f898271367b1/users/35924026d24846deac786849ecd4d20f/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:04.247044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:04.258784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114311-3490-489f-9f09-2665e909fd64 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.320658 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44a1fc-4ccd-48e7-b7aa-abea2cd429f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.321291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44a1fc-4ccd-48e7-b7aa-abea2cd429f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.321572 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44a1fc-4ccd-48e7-b7aa-abea2cd429f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.321842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44a1fc-4ccd-48e7-b7aa-abea2cd429f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.322476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44a1fc-4ccd-48e7-b7aa-abea2cd429f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:04.324043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44a1fc-4ccd-48e7-b7aa-abea2cd429f6 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:04.333940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1357/2700] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:04.338736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:04.353219 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a1eda-c384-44df-ae97-1f93ce1fd479 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.358142 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.362936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.362936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.362936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] PATH_INFO: `/v3/projects/01514d791f8d44178943f898271367b1/users/35924026d24846deac786849ecd4d20f/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.362936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01514d791f8d44178943f898271367b1, user_id=35924026d24846deac786849ecd4d20f, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:04.364155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:04.374725 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1344/2701] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:04 2022] PUT /identity/v3/projects/01514d791f8d44178943f898271367b1/users/35924026d24846deac786849ecd4d20f/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:04.386170 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.386455 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.389231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.417193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] MFA Rules not processed for user `35924026d24846deac786849ecd4d20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:04.418602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:04.439395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:04.488421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1358/2702] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:04.729421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:04.807915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d6911-3fd7-4f21-86da-4d6cbf942367 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.811801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.812550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.812874 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.813198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.823095 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:04.824544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:04.844034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1345/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:04.951409 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:04.961682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71459cee-bc2b-43f2-98f1-ce3c39ec57a1 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:04.965156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:04.965797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:04.966076 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:04.966346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:04.970228 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:05.001174 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:05.009666 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1109-59a3-4919-886c-5e804163c963 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:05.014002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63574-16b8-451a-87f4-349aa3a69d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:05.016352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63574-16b8-451a-87f4-349aa3a69d15 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:05.016352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63574-16b8-451a-87f4-349aa3a69d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:05.016352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63574-16b8-451a-87f4-349aa3a69d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:05.040499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:05.042005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:05.047482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:05.051441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1359/2704] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:05.098235 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d63574-16b8-451a-87f4-349aa3a69d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:05.099934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d63574-16b8-451a-87f4-349aa3a69d15 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:05.109591 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1346/2705] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:06.105189 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:06.168546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f99c-c0ef-47f0-a9e3-9babcd3a2208 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:06.173277 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:06.173894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:06.174165 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:06.174434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] PATH_INFO: `/v3/users/f2c725a5e46c4849bdbd506e3b086fad` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:06.175531 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c725a5e46c4849bdbd506e3b086fad)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:06.177563 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:06.359965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c725a5e46c4849bdbd506e3b086fad'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:06.430779 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c725a5e46c4849bdbd506e3b086fad'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:06.431404 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c725a5e46c4849bdbd506e3b086fad'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:06.432008 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c725a5e46c4849bdbd506e3b086fad'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:06.437891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:06.441425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c725a5e46c4849bdbd506e3b086fad'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:06.459025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1360/2706] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:06 2022] DELETE /identity/v3/users/f2c725a5e46c4849bdbd506e3b086fad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:06.463511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:06.464003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:06.464003 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:06.483392 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:06.484629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:06.542316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1347/2707] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:06.552041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:06.553993 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:06.619946 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4eab9-81f1-46b7-bf2b-1abeede7f915 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:06.623654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:06.624275 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:06.624580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:06.624849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:06.638916 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:06.640602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:06.650816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1361/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:07.172699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:07.174401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:07.192490 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7229a4-16ca-4cc7-b44f-e7db63c67447 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:07.199274 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:07.200965 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:07.201213 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:07.201528 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] PATH_INFO: `/v3/projects/2e9bbe52c5694bb0b26619508c3c5e81` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:07.202779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9bbe52c5694bb0b26619508c3c5e81)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:07.205901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:07.320807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9bbe52c5694bb0b26619508c3c5e81', 'request_id': 'req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.327365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9bbe52c5694bb0b26619508c3c5e81', 'request_id': 'req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.391880 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9bbe52c5694bb0b26619508c3c5e81', 'request_id': 'req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.412059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] The token cache is being invalidate because project 2e9bbe52c5694bb0b26619508c3c5e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:07.412408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.413271 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.414939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1348/2709] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:07 2022] DELETE /identity/v3/projects/2e9bbe52c5694bb0b26619508c3c5e81 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:07.418930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:07.429190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efbc7-b082-437d-9ffe-bfffc54ff511 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:07.487739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:07.488522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:07.488813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:07.489091 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] PATH_INFO: `/v3/users/35924026d24846deac786849ecd4d20f` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:07.490254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35924026d24846deac786849ecd4d20f)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:07.492279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:07.747542 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35924026d24846deac786849ecd4d20f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.834166 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35924026d24846deac786849ecd4d20f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.835489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35924026d24846deac786849ecd4d20f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.836333 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35924026d24846deac786849ecd4d20f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.843994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-a7d75738-b1b1-4150-9673-024bb2e148c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35924026d24846deac786849ecd4d20f'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:07.857900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:07.863456 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1362/2710] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:07 2022] DELETE /identity/v3/users/35924026d24846deac786849ecd4d20f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:08.339131 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:08.345629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:08.360630 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ec90-1a6f-40d4-beb9-84ec2cd6fe2a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:08.413599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:08.453053 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:08.453779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:08.454134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:08.454494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] PATH_INFO: `/v3/projects/01514d791f8d44178943f898271367b1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:08.455761 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=01514d791f8d44178943f898271367b1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:08.457795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:08.586731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01514d791f8d44178943f898271367b1', 'request_id': 'req-3a9f38dc-1731-435a-90ce-80a50f793ccf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:08.593239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01514d791f8d44178943f898271367b1', 'request_id': 'req-3a9f38dc-1731-435a-90ce-80a50f793ccf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:08.687249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01514d791f8d44178943f898271367b1', 'request_id': 'req-3a9f38dc-1731-435a-90ce-80a50f793ccf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:08.699309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] The token cache is being invalidate because project 01514d791f8d44178943f898271367b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:08.699607 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:08.700253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a9f38dc-1731-435a-90ce-80a50f793ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:08.701887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1349/2711] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:08 2022] DELETE /identity/v3/projects/01514d791f8d44178943f898271367b1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:08.708925 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:08.709476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:08.709476 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:08.743351 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:08.744499 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:08.807940 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1363/2712] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:08.815592 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:08.820740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:08.820740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:08.836881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:08.838148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:08.846005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1350/2713] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:08.852835 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:08.860445 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feff5a3-1400-48fe-87b9-23d3d9a59995 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:08.865362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:08.865953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:08.866232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:08.866504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:08.867882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:08.868247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:08.869863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:08.897231 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1364/2714] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:13:08.903015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:08.912776 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd5c0-726c-48a6-91c5-e02a56e54a77 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:08.920191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:08.920895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:08.921134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:08.921416 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:08.922204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:08.924109 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.086368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1351/2715] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:08 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:09.087848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.097910 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22274-3f01-40e4-acab-248ebe8bef88 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.166816 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.167694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.168164 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.168582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.169314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.171506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.303069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1365/2716] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:09 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:09.308417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.319457 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d77cbd-97d4-4a1f-80fe-257c1a11eaaa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.324366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.324979 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.325370 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.325647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.326447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.328085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.338323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1352/2717] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:09.342489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.353848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f42e0-b59f-4e51-bf3f-30e4c3171f76 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.358558 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.359158 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.359438 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.359707 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.360367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.362040 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.373740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1366/2718] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:09.378092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.389325 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a44454-c5e7-4f98-91f5-bbb93a79754e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.394055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f403d-4057-4435-a84a-84afba762ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.394710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f403d-4057-4435-a84a-84afba762ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.394990 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f403d-4057-4435-a84a-84afba762ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.395265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f403d-4057-4435-a84a-84afba762ed9 admin admin] PATH_INFO: `/v3/projects/d488722dece14bd097d14c3bd33fe362/users/b42b38c8775d47c7b7d0c09e805a31be/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.413823 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f403d-4057-4435-a84a-84afba762ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d488722dece14bd097d14c3bd33fe362, user_id=b42b38c8775d47c7b7d0c09e805a31be, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.416648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f403d-4057-4435-a84a-84afba762ed9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.428386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.430709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:09.482295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1353/2719] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:09 2022] PUT /identity/v3/projects/d488722dece14bd097d14c3bd33fe362/users/b42b38c8775d47c7b7d0c09e805a31be/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:09.487763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da5a7-11a4-42b6-bf12-c62678a63233 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.493242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.493552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.493877 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.504982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:09.522803 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] MFA Rules not processed for user `b42b38c8775d47c7b7d0c09e805a31be`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:09.524243 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:09.540442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.541239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.541534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.541823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.543673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:09.583234 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:09.592226 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1354/2720] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:09.596667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.612424 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.613847 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.624257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1367/2721] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:09.659263 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9d0b-0489-4079-aef9-a2115b9077e1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.665878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.665878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.666183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.666458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.667108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.669038 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.740409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1355/2722] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:09 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:09.745256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.756193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f29d-9f23-4086-ae9c-2ae0511b0cb0 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.813802 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.814411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.814680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.815118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.815763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.817741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.899211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1368/2723] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:09 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:09.903303 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.913683 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726f95-c4c1-4d45-aea3-25d3e601b332 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.918472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.919098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.919405 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.919828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.920507 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.922088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.932168 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1356/2724] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:09.936262 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.946867 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9558-6772-4f42-9450-d4c5a003e46c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.951854 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03ce8e-9695-4b8c-985d-94ee67f7efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.952489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ce8e-9695-4b8c-985d-94ee67f7efba admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.952768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ce8e-9695-4b8c-985d-94ee67f7efba admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.953039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ce8e-9695-4b8c-985d-94ee67f7efba admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:09.953674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03ce8e-9695-4b8c-985d-94ee67f7efba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:09.955261 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03ce8e-9695-4b8c-985d-94ee67f7efba admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:09.966896 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1369/2725] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:09.972368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:09.981879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41654840-279e-492e-9043-5a3d2a91d86a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:09.986904 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:09.987549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:09.987828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:09.988211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] PATH_INFO: `/v3/projects/f6b1c66d2d3e4d539b6969025b526d63/users/64b7b9011a7d4e5cad3f5f630e4f1930/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.003402 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b1c66d2d3e4d539b6969025b526d63, user_id=64b7b9011a7d4e5cad3f5f630e4f1930, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.006146 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.099896 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1357/2726] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:09 2022] PUT /identity/v3/projects/f6b1c66d2d3e4d539b6969025b526d63/users/64b7b9011a7d4e5cad3f5f630e4f1930/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:10.112363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.112363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.112363 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.142251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] MFA Rules not processed for user `64b7b9011a7d4e5cad3f5f630e4f1930`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:10.143464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:10.191555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:10.221041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1370/2727] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:10.225404 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.301901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.303376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:10.314840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3454b-cd2b-4950-ac18-62238bfb15a1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.319888 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.320560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.320919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.321203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.321987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.324069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.376286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744a8ef-a955-45d9-bb10-13576860bdb1 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.379891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.380716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.381055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.381393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.383276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:10.423751 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1358/2728] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:10 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:10.424704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.450331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.451908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.457207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:10.461464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1371/2729] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:10.490218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472211f4-b9cb-4dc9-925b-b9f853cdf600 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.496253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.496902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.497188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.500135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.500135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.500397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.591367 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1359/2730] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:10 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:10.595364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.606976 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea968-4d04-4a34-a717-ade4399f8c09 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.611506 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.612138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.612448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.612720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.613397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.615273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.627625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1372/2731] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:10.631994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.650079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbe4cd-321f-4002-a846-fa05fb77b58e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.654838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.655523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.655843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.656137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] PATH_INFO: `/v3/projects/19ec8ce0ab29472da136d43f840fbc60/users/340097ef930344eca597f3ebcb5cfff3/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.672371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ec8ce0ab29472da136d43f840fbc60, user_id=340097ef930344eca597f3ebcb5cfff3, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.675132 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.746107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1360/2732] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:10 2022] PUT /identity/v3/projects/19ec8ce0ab29472da136d43f840fbc60/users/340097ef930344eca597f3ebcb5cfff3/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:10.750256 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.764502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b013d-a5d8-4285-a791-6a9645ee7971 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.823429 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5527b-e230-45fd-95ea-fa07dd13bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.824809 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5527b-e230-45fd-95ea-fa07dd13bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.825116 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5527b-e230-45fd-95ea-fa07dd13bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.825386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5527b-e230-45fd-95ea-fa07dd13bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.826026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5527b-e230-45fd-95ea-fa07dd13bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.827596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5527b-e230-45fd-95ea-fa07dd13bb36 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.842874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1373/2733] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:10.843986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:10.855854 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8fd03-a930-472b-88fa-b203b306ac0f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:10.860733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:10.861550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.861954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.862327 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] PATH_INFO: `/v3/projects/19ec8ce0ab29472da136d43f840fbc60/users/340097ef930344eca597f3ebcb5cfff3/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.864452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ec8ce0ab29472da136d43f840fbc60, user_id=340097ef930344eca597f3ebcb5cfff3, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:10.868558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:10.878887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1361/2734] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:10 2022] PUT /identity/v3/projects/19ec8ce0ab29472da136d43f840fbc60/users/340097ef930344eca597f3ebcb5cfff3/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:10.890217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:10.890519 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:10.890796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:10.919471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] MFA Rules not processed for user `340097ef930344eca597f3ebcb5cfff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:10.920741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:10.925966 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:10.988845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1374/2735] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:11.000037 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:11.059581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429e21-87e7-4335-8e7c-a08fc8dca2cc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:11.063314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:11.070074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:11.070074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:11.070074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:11.124108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:11.125660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:11.134905 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1362/2736] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:13.169671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:13.179021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce075c-ae6a-4ddb-a450-1e19a97db5ec None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:13.183263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fc449-7841-4681-8b98-f4877e7e5225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:13.183857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc449-7841-4681-8b98-f4877e7e5225 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:13.184136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc449-7841-4681-8b98-f4877e7e5225 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:13.184441 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc449-7841-4681-8b98-f4877e7e5225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:13.242908 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc449-7841-4681-8b98-f4877e7e5225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:13.244478 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc449-7841-4681-8b98-f4877e7e5225 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:13.253787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1375/2737] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:13.341879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:13.343319 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:13.385106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:13.410117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32127372-4459-4c27-a68a-93b9c2a8fb40 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:13.415056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:13.415687 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:13.415967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:13.416273 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] PATH_INFO: `/v3/users/c9b84b1c7d4f43dca8d66a8072b16e21` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:13.417520 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b84b1c7d4f43dca8d66a8072b16e21)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:13.419438 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:13.575344 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b84b1c7d4f43dca8d66a8072b16e21'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:13.673379 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b84b1c7d4f43dca8d66a8072b16e21'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:13.674018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b84b1c7d4f43dca8d66a8072b16e21'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:13.674619 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b84b1c7d4f43dca8d66a8072b16e21'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:13.683539 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b84b1c7d4f43dca8d66a8072b16e21'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:13.701187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1363/2738] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:13 2022] DELETE /identity/v3/users/c9b84b1c7d4f43dca8d66a8072b16e21 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:13.705624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:13.705903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:13.706175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:13.725249 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:13.726425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:13.784479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1376/2739] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:13.794954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:13.796492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:13.864649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f9f1-354f-4191-821b-26a55ebc3940 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:13.869110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23946add-ac0c-494c-a414-a578f17ee4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:13.869787 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23946add-ac0c-494c-a414-a578f17ee4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:13.870064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23946add-ac0c-494c-a414-a578f17ee4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:13.870337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23946add-ac0c-494c-a414-a578f17ee4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:13.879740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23946add-ac0c-494c-a414-a578f17ee4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:13.881184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23946add-ac0c-494c-a414-a578f17ee4c5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:13.904604 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1364/2740] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:14.303597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:14.305405 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:14.317895 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b86bc-9b13-4d0f-a494-3204dd0b3f55 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:14.324889 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:14.325540 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:14.325813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:14.326084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] PATH_INFO: `/v3/projects/8891e4522c554d29b93a5425b318bca7` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:14.327254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8891e4522c554d29b93a5425b318bca7)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:14.329288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:14.439957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:14.449419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8891e4522c554d29b93a5425b318bca7', 'request_id': 'req-17d37193-01f7-4a87-9710-72f757a3c5cc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:14.455447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8891e4522c554d29b93a5425b318bca7', 'request_id': 'req-17d37193-01f7-4a87-9710-72f757a3c5cc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:14.573425 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8891e4522c554d29b93a5425b318bca7', 'request_id': 'req-17d37193-01f7-4a87-9710-72f757a3c5cc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:14.585518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] The token cache is being invalidate because project 8891e4522c554d29b93a5425b318bca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:14.585813 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:14.586489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-17d37193-01f7-4a87-9710-72f757a3c5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:14.597252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1377/2741] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:14 2022] DELETE /identity/v3/projects/8891e4522c554d29b93a5425b318bca7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:14.597361 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:14.597811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:14.597811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:14.619211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:14.621386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:14.672191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:14.682650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1365/2742] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:14.693156 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:14.693495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:14.693842 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:14.716821 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:14.718035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:14.728613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:14.732901 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1378/2743] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:14.733044 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:14.733747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:14.743448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671c8ce-af79-4247-8121-8efcde5a12ae None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:14.748032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:14.748649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:14.748923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:14.749193 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:14.749823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:14.750118 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:14.751677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:14.771938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1379/2744] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:13:14.777119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:14.787309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f6cb4-350b-48c1-aaa4-30d8d513c1ec admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:14.792682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:14.793749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:14.793749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:14.793965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:14.794546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:14.796457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:14.798439 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d6b2-0552-4986-be71-6bd37c38a469 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:14.804746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:14.807947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:14.808240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:14.808550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:14.812441 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:14.879012 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:14.880495 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:14.890692 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1366/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:14.928113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1380/2746] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:14 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:14.933040 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:14.943442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ef99-ee83-4450-bd3c-f06f4cc64ebd service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.002971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.003579 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.003859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.004135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.004791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.006789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.296276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:15.298220 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:15.311230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1367/2747] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:14 2022] POST /identity/v3/users => generated 292 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:15.311689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0837-6595-4ec9-9a99-421da74e2308 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.315320 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:15.316473 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.317113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.317393 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.317667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] PATH_INFO: `/v3/users/b1a508029e8d4fa697cac69a224d4e30` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.318789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a508029e8d4fa697cac69a224d4e30)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.320806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.325682 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e2ecd-b6ee-4e90-9aab-7f9303a83070 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.330769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.331779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.332161 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.332601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.333333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.335107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.346813 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1368/2748] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:15.350879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:15.365238 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c810c5-42c1-4fed-8ae5-14002f7f71db admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.370801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.371395 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.371674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.371944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.372612 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.374207 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.384934 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1369/2749] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:15.389646 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:15.398581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4f5c5-244e-48d3-b03a-c02a27e718cb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.403636 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05a960-7f29-44bc-ab71-2d9ec94ce993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.404284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05a960-7f29-44bc-ab71-2d9ec94ce993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.404597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05a960-7f29-44bc-ab71-2d9ec94ce993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.404870 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05a960-7f29-44bc-ab71-2d9ec94ce993 admin admin] PATH_INFO: `/v3/projects/9ac3902143404137ba24b2b3d60215e4/users/2916d230ca9d43fc94dea90a0781973d/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.418440 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:15.423166 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05a960-7f29-44bc-ab71-2d9ec94ce993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac3902143404137ba24b2b3d60215e4, user_id=2916d230ca9d43fc94dea90a0781973d, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.425902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05a960-7f29-44bc-ab71-2d9ec94ce993 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.545291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1370/2750] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:15 2022] PUT /identity/v3/projects/9ac3902143404137ba24b2b3d60215e4/users/2916d230ca9d43fc94dea90a0781973d/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:15.550083 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.550371 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.550648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.570002 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:15.571678 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:15.581140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a508029e8d4fa697cac69a224d4e30'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:15.633005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1371/2751] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:15.642954 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:15.644419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:15.664087 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a508029e8d4fa697cac69a224d4e30'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:15.665798 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a508029e8d4fa697cac69a224d4e30'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:15.666403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a508029e8d4fa697cac69a224d4e30'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:15.675297 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96b84004-077a-4e34-bce9-0ccbcebb642c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a508029e8d4fa697cac69a224d4e30'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:15.692417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1381/2752] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:15 2022] DELETE /identity/v3/users/b1a508029e8d4fa697cac69a224d4e30 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:15.697036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.697330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.697740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.702119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c1349-43ed-437c-976f-f023ce33de5e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.717067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:15.718273 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:15.752927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.753545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.753828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.754107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.756603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:15.769019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:15.785817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1382/2753] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:15.801047 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:15.802510 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:15.815208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd5c77-4160-46d8-866a-aaa24b90b450 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:15.819725 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:15.820553 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:15.821622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:15.821996 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:15.832187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.833713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.834560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:15.836145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:15.841015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:15.844117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1383/2754] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:15.847143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1372/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:16.317150 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:16.319623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:16.339502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c18cc-22e4-48f3-b0a9-f189fbff0790 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:16.346885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:16.346885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:16.347528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:16.347728 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] PATH_INFO: `/v3/projects/ba85d17b0a1242059e06a5f6488b42ea` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:16.349073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba85d17b0a1242059e06a5f6488b42ea)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:16.351488 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:16.504776 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba85d17b0a1242059e06a5f6488b42ea', 'request_id': 'req-b335bedc-b745-4cec-ae08-8b318caca5b0'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.511550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:16.512871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba85d17b0a1242059e06a5f6488b42ea', 'request_id': 'req-b335bedc-b745-4cec-ae08-8b318caca5b0'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.513454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:16.525522 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98f3a3-7aff-4645-bc8a-e75d1e8c920b service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:16.588087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:16.588659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:16.589336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:16.589855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] PATH_INFO: `/v3/users/8be65f00988d4f6499da5f46ea9a5e9e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:16.590879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be65f00988d4f6499da5f46ea9a5e9e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:16.592840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:16.619159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba85d17b0a1242059e06a5f6488b42ea', 'request_id': 'req-b335bedc-b745-4cec-ae08-8b318caca5b0'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.632621 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] The token cache is being invalidate because project ba85d17b0a1242059e06a5f6488b42ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:16.632978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.633706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.635490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1384/2756] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:16 2022] DELETE /identity/v3/projects/ba85d17b0a1242059e06a5f6488b42ea => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:16.638980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:16.640358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:16.653320 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335bedc-b745-4cec-ae08-8b318caca5b0 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:16.658207 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:16.658837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:16.659119 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:16.659440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] PATH_INFO: `/v3/users/dce3218e82af4f66b0433d6a2060a89c` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:16.660633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce3218e82af4f66b0433d6a2060a89c)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:16.662619 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:16.861624 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be65f00988d4f6499da5f46ea9a5e9e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.865117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce3218e82af4f66b0433d6a2060a89c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.950006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be65f00988d4f6499da5f46ea9a5e9e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.950691 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be65f00988d4f6499da5f46ea9a5e9e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.951353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be65f00988d4f6499da5f46ea9a5e9e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.959286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fc849ce1-614b-46e4-992e-a5e3a0013c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be65f00988d4f6499da5f46ea9a5e9e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:16.978084 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1373/2757] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:16 2022] DELETE /identity/v3/users/8be65f00988d4f6499da5f46ea9a5e9e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:16.982380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:16.982667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:16.982944 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:17.001554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:17.002727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:17.047248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce3218e82af4f66b0433d6a2060a89c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:17.047887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce3218e82af4f66b0433d6a2060a89c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:17.048550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce3218e82af4f66b0433d6a2060a89c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:17.057188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce3218e82af4f66b0433d6a2060a89c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:17.069724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1374/2758] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:17.078807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1385/2759] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:16 2022] DELETE /identity/v3/users/dce3218e82af4f66b0433d6a2060a89c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:17.085614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:17.088170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:17.113187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:17.158480 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1069ae-71d3-4f84-b62c-3988023ec3f8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:17.207398 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:17.208009 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:17.208293 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:17.208599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:17.270737 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:17.272171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:17.281492 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1375/2760] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:17.627693 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:17.629268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:17.643240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64458a70-cf8b-4b56-a7df-e45f9c2bf1ca admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:17.656065 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:17.659774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:17.659774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:17.659774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] PATH_INFO: `/v3/projects/77bc0f7cdf674957a2b38add3a1ab0e7` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:17.659774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bc0f7cdf674957a2b38add3a1ab0e7)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:17.661282 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:17.818311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:17.823475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:17.825754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:17.843429 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9ec6-6a38-4f00-bd0d-278a644dcd30 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:17.847427 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bc0f7cdf674957a2b38add3a1ab0e7', 'request_id': 'req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:17.862141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bc0f7cdf674957a2b38add3a1ab0e7', 'request_id': 'req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:17.967455 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:17.968098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:17.968408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:17.968686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] PATH_INFO: `/v3/projects/ac7a1da3e1b34c45821edfe2a862e47a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:17.969811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7a1da3e1b34c45821edfe2a862e47a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:17.971722 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:17.995088 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bc0f7cdf674957a2b38add3a1ab0e7', 'request_id': 'req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.007332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] The token cache is being invalidate because project 77bc0f7cdf674957a2b38add3a1ab0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:18.007622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.008848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.011005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1386/2761] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:17 2022] DELETE /identity/v3/projects/77bc0f7cdf674957a2b38add3a1ab0e7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:18.014838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:18.016127 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:18.030606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e049c7-43dc-4e66-bd56-1c14eac6bbf1 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:18.036167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:18.036863 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:18.037141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:18.037413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] PATH_INFO: `/v3/users/7d6e1c489b484d9b88dd9aaa77f01a06` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:18.038582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6e1c489b484d9b88dd9aaa77f01a06)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:18.041328 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:18.158298 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:18.245034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7a1da3e1b34c45821edfe2a862e47a', 'request_id': 'req-cfca9f9f-8805-467f-b240-a89735d695c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.250577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6e1c489b484d9b88dd9aaa77f01a06'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.252876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7a1da3e1b34c45821edfe2a862e47a', 'request_id': 'req-cfca9f9f-8805-467f-b240-a89735d695c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.339410 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6e1c489b484d9b88dd9aaa77f01a06'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.340044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6e1c489b484d9b88dd9aaa77f01a06'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.340773 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6e1c489b484d9b88dd9aaa77f01a06'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.348838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6e1c489b484d9b88dd9aaa77f01a06'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.370675 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1387/2762] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:18 2022] DELETE /identity/v3/users/7d6e1c489b484d9b88dd9aaa77f01a06 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:18.390252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7a1da3e1b34c45821edfe2a862e47a', 'request_id': 'req-cfca9f9f-8805-467f-b240-a89735d695c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.413472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] The token cache is being invalidate because project ac7a1da3e1b34c45821edfe2a862e47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:18.413916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.417494 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.420253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1376/2763] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:17 2022] DELETE /identity/v3/projects/ac7a1da3e1b34c45821edfe2a862e47a => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:18.424153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:18.425674 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:18.523188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929ad6-864f-45bc-bd58-74bb278869e0 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:18.529335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:18.529980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:18.532341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:18.532341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] PATH_INFO: `/v3/users/fd895193b8fb4318891078768d285e93` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:18.532341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd895193b8fb4318891078768d285e93)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:18.533671 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:18.738824 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd895193b8fb4318891078768d285e93'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.871371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd895193b8fb4318891078768d285e93'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.872101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd895193b8fb4318891078768d285e93'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.872874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd895193b8fb4318891078768d285e93'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.881757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-871e08c3-8b7f-4204-b50d-4e58afa49bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd895193b8fb4318891078768d285e93'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:18.901987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1388/2764] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:18 2022] DELETE /identity/v3/users/fd895193b8fb4318891078768d285e93 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:18.950329 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:18.951930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:19.045076 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca9f9f-8805-467f-b240-a89735d695c8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:19.112586 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:19.113218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.113505 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.113819 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] PATH_INFO: `/v3/projects/95c708a1faba422683e232d8c4e01972` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.115011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c708a1faba422683e232d8c4e01972)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:19.116971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:19.249158 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c708a1faba422683e232d8c4e01972', 'request_id': 'req-66eeda7a-63bc-4184-9938-f611cff62a04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.264250 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c708a1faba422683e232d8c4e01972', 'request_id': 'req-66eeda7a-63bc-4184-9938-f611cff62a04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.325079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:19.372212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c708a1faba422683e232d8c4e01972', 'request_id': 'req-66eeda7a-63bc-4184-9938-f611cff62a04'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.374629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:19.384532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] The token cache is being invalidate because project 95c708a1faba422683e232d8c4e01972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:19.384835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.385509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.387096 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1377/2765] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:18 2022] DELETE /identity/v3/projects/95c708a1faba422683e232d8c4e01972 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:19.393121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb6bf-5161-4cde-81e2-6f42a7593a5b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.393493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb6bf-5161-4cde-81e2-6f42a7593a5b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.393872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb6bf-5161-4cde-81e2-6f42a7593a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.416909 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-3abeb6bf-5161-4cde-81e2-6f42a7593a5b None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:19.418279 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-3abeb6bf-5161-4cde-81e2-6f42a7593a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:19.460183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:19.462875 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:19.528346 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1389/2766] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:19.536959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.537246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.537521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.558555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:19.558796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeda7a-63bc-4184-9938-f611cff62a04 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:19.562036 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:19.564338 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:19.565128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.565469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.565685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] PATH_INFO: `/v3/projects/dd372fb0c6d04f719587538482772162` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.566845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd372fb0c6d04f719587538482772162)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:19.568809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:19.572906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1390/2767] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:19.577479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:19.588528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65de85d-021d-43d3-978a-ac4c41630991 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:19.594930 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:19.595546 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.595825 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.596096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.597058 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:19.597367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:19.599070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:19.613505 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1391/2768] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 11:13:19.618525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:19.634711 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e02f7-68ad-4a70-aaee-1e57dbbe512d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:19.640252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:19.641094 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.645705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.645705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.645705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:19.645705 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:19.693290 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd372fb0c6d04f719587538482772162', 'request_id': 'req-b6070747-bb83-4a76-aeba-b53425e867d1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.703868 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd372fb0c6d04f719587538482772162', 'request_id': 'req-b6070747-bb83-4a76-aeba-b53425e867d1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.766169 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1392/2769] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:19 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:19.767756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:19.769720 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:19.778573 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd372fb0c6d04f719587538482772162', 'request_id': 'req-b6070747-bb83-4a76-aeba-b53425e867d1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.801686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] The token cache is being invalidate because project dd372fb0c6d04f719587538482772162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:19.802294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.804400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:19.807775 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1378/2770] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:19 2022] DELETE /identity/v3/projects/dd372fb0c6d04f719587538482772162 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:19.808976 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:19.813181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:19.879805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f130251-067e-4ae9-8cb3-5f0ce5fb8e4c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:19.885815 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:19.886689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.886967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.888011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] PATH_INFO: `/v3/users/b42b38c8775d47c7b7d0c09e805a31be` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.889672 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42b38c8775d47c7b7d0c09e805a31be)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:19.891611 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:19.929150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070747-bb83-4a76-aeba-b53425e867d1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:19.935050 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6a765-8133-41c6-8bbd-812b54eef03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:19.935735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a765-8133-41c6-8bbd-812b54eef03d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:19.940805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a765-8133-41c6-8bbd-812b54eef03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:19.940805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a765-8133-41c6-8bbd-812b54eef03d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:19.940805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6a765-8133-41c6-8bbd-812b54eef03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:19.940805 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6a765-8133-41c6-8bbd-812b54eef03d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.103830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1379/2771] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:19 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:20.106606 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.107060 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.107481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.132535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:20.134212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.145947 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1380/2772] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:20.147373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.158987 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74dba-6d07-40ac-9650-50bb83c92e59 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.164997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ec999-1d62-42bb-a74b-0c4c71dc0d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.165985 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ec999-1d62-42bb-a74b-0c4c71dc0d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.166419 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ec999-1d62-42bb-a74b-0c4c71dc0d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.166856 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ec999-1d62-42bb-a74b-0c4c71dc0d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.168189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ec999-1d62-42bb-a74b-0c4c71dc0d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.169968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ec999-1d62-42bb-a74b-0c4c71dc0d75 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.181112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1381/2773] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:20.182650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.183167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.183654 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.193866 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42b38c8775d47c7b7d0c09e805a31be'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:20.205665 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:20.207086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.216052 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1382/2774] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:20.217266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.228469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c32625-c1f1-43f5-ae30-137ff142d5de None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.233488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.234410 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.234931 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.235365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.236156 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.237927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.249916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1383/2775] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:20.251211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.263910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0734d86-8c25-4cd7-835e-7506e69934ff admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.269389 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.270000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.270278 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.270547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.271307 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:20.271732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.273491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63523627-4d1e-422a-958c-6867051f31b5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.275568 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42b38c8775d47c7b7d0c09e805a31be'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:20.276607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42b38c8775d47c7b7d0c09e805a31be'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:20.278019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42b38c8775d47c7b7d0c09e805a31be'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:20.291435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42b38c8775d47c7b7d0c09e805a31be'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:20.323983 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1393/2776] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:19 2022] DELETE /identity/v3/users/b42b38c8775d47c7b7d0c09e805a31be => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:20.327757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.329317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.433639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7e2ef-0039-4fc5-a39b-a97e99303fcc admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.436349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1384/2777] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:13:20.437362 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.437672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.438091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.444963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.446471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.446754 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.447035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] PATH_INFO: `/v3/projects/83866131da794c60b7dada0e099bf2a6/users/129f3970fcb94cc88a02f4913bba7adc/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.466887 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83866131da794c60b7dada0e099bf2a6, user_id=129f3970fcb94cc88a02f4913bba7adc, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.467668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:20.468912 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.469667 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.477437 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1385/2778] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:20.478412 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.479713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.492064 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc82542-898c-4e43-b6ae-a9d380687a15 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.497832 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.498620 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.498959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.499240 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.499873 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.501806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.577507 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1394/2779] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:20 2022] PUT /identity/v3/projects/83866131da794c60b7dada0e099bf2a6/users/129f3970fcb94cc88a02f4913bba7adc/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:20.578353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.582445 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.585739 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1386/2780] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:20.589970 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.596174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:20.660656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50ce2f-3a0a-4a13-8fc1-597316462cf5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.674041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19185274-b470-4ffa-b37d-9b292fbed606 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.679706 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54b418-2bf4-4e2f-900d-6af46e1744fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.693067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54b418-2bf4-4e2f-900d-6af46e1744fc admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.693067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54b418-2bf4-4e2f-900d-6af46e1744fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.693067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54b418-2bf4-4e2f-900d-6af46e1744fc admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.693067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54b418-2bf4-4e2f-900d-6af46e1744fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.693067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54b418-2bf4-4e2f-900d-6af46e1744fc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.708366 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:20.756778 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1387/2781] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:20.758170 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.758458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.758863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.776873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.777408 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.777756 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.778041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.794306 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.795729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.807175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1395/2782] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:20.812653 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.823486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d64d9-7e4e-446f-ab21-f30c20cee7e7 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.829268 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.830361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.830661 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.830938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.831588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.833746 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.841652 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] MFA Rules not processed for user `129f3970fcb94cc88a02f4913bba7adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:20.842895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:20.846274 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1396/2783] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:20.851043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.864859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32cf33-e288-468f-8090-0108126d65c0 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.868944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.869644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.869988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.870335 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.871052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.872876 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.893347 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1397/2784] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:20.894374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.905318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f91ba-d19a-487b-8bf8-e9570568dd2b admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.911587 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40db3e4-a97f-48d2-91df-d9a3140bb4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.912219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40db3e4-a97f-48d2-91df-d9a3140bb4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.912561 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40db3e4-a97f-48d2-91df-d9a3140bb4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.912845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40db3e4-a97f-48d2-91df-d9a3140bb4ef admin admin] PATH_INFO: `/v3/projects/61eea6f99326498db4f8686edd8dacd6/users/642ae1473da345079f4ccd1f1cfb080c/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.931787 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40db3e4-a97f-48d2-91df-d9a3140bb4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=61eea6f99326498db4f8686edd8dacd6, user_id=642ae1473da345079f4ccd1f1cfb080c, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.934494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40db3e4-a97f-48d2-91df-d9a3140bb4ef admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:20.962729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1388/2785] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:20.973428 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:20.986881 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57edc8-2806-4b74-9957-e3510d1923a2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:20.993357 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:20.994056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:20.994337 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:20.994611 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:20.995444 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:20.997700 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.027960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1398/2786] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:20 2022] PUT /identity/v3/projects/61eea6f99326498db4f8686edd8dacd6/users/642ae1473da345079f4ccd1f1cfb080c/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:21.032742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.032742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.032742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.073468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] MFA Rules not processed for user `642ae1473da345079f4ccd1f1cfb080c`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:21.076543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:21.106221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1389/2787] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:20 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:21.110341 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.199290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1399/2788] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:21.206689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.217861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:21.238103 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d3ca4-4c5d-45a0-aa35-a3da0310b9fd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.259375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.259375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.259375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.259375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.259754 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.262081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.321685 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c723-3ead-4b43-8098-5d457c1435b3 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.341800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1390/2789] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:21 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:21.345434 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.374112 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307402-1cd6-441f-86bd-5a91afb520eb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.384035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.384594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.385164 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.385786 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.386115 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.387731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.391470 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.392508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.393596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.394153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.408141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1391/2790] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:21.413705 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.433982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314938-97e8-4a15-bb55-c03ff78bb57f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.452895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.453566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.453843 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.454735 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] PATH_INFO: `/v3/projects/7878e1c913814b36a425747f12f7f1d5/users/0ffe15dd27ea4b7a85a7a735fde02fab/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.489088 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7878e1c913814b36a425747f12f7f1d5, user_id=0ffe15dd27ea4b7a85a7a735fde02fab, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.491859 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.498701 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.500267 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.511138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1400/2791] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:21.512417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.514970 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:21.532796 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87c475-2336-4e2b-978f-cf0aa5e214c7 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.548472 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.549459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.554448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.554448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] PATH_INFO: `/v3/projects/d488722dece14bd097d14c3bd33fe362` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.554448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d488722dece14bd097d14c3bd33fe362)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.554448 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.579276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1392/2792] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:21 2022] PUT /identity/v3/projects/7878e1c913814b36a425747f12f7f1d5/users/0ffe15dd27ea4b7a85a7a735fde02fab/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:21.583091 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.652183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce96e2-5163-4cba-adcd-43fa64d79a82 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.657283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.657975 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.658261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.658532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] PATH_INFO: `/v3/users/642ae1473da345079f4ccd1f1cfb080c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.659826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=642ae1473da345079f4ccd1f1cfb080c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.661672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.669963 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:21.719703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd488722dece14bd097d14c3bd33fe362', 'request_id': 'req-5b12246a-ba52-4261-8906-309e46d8d1f7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:21.728167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd488722dece14bd097d14c3bd33fe362', 'request_id': 'req-5b12246a-ba52-4261-8906-309e46d8d1f7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:21.818386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd488722dece14bd097d14c3bd33fe362', 'request_id': 'req-5b12246a-ba52-4261-8906-309e46d8d1f7'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:21.818974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:21.833577 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] The token cache is being invalidate because project d488722dece14bd097d14c3bd33fe362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:21.834022 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:21.834713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:21.837071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1401/2793] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:21 2022] DELETE /identity/v3/projects/d488722dece14bd097d14c3bd33fe362 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:21.840515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.841979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:21.915359 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12246a-ba52-4261-8906-309e46d8d1f7 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.920696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.921332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.925353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.925353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.925353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.925353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:21.932672 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642ae1473da345079f4ccd1f1cfb080c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:21.935851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1402/2794] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:21.937024 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:21.938740 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:21.952829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c595-9749-4496-bd92-f16f9fbadac7 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:21.958317 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:21.959246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:21.959714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:21.960298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] PATH_INFO: `/v3/users/64b7b9011a7d4e5cad3f5f630e4f1930` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:21.962574 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b7b9011a7d4e5cad3f5f630e4f1930)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:21.964738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:22.010729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642ae1473da345079f4ccd1f1cfb080c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.011616 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642ae1473da345079f4ccd1f1cfb080c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.012433 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642ae1473da345079f4ccd1f1cfb080c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.020992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642ae1473da345079f4ccd1f1cfb080c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.052677 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1393/2795] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:21 2022] DELETE /identity/v3/users/642ae1473da345079f4ccd1f1cfb080c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:22.058984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:22.060681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.137321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea9d6-c41a-44dd-a9e8-14d1050eef2f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:22.144247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76b48f-12be-44f7-a7bf-9c702a45d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:22.145149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b48f-12be-44f7-a7bf-9c702a45d20d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.145563 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b48f-12be-44f7-a7bf-9c702a45d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.145849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b48f-12be-44f7-a7bf-9c702a45d20d admin admin] PATH_INFO: `/v3/projects/7878e1c913814b36a425747f12f7f1d5/users/0ffe15dd27ea4b7a85a7a735fde02fab/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.147835 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76b48f-12be-44f7-a7bf-9c702a45d20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7878e1c913814b36a425747f12f7f1d5, user_id=0ffe15dd27ea4b7a85a7a735fde02fab, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:22.162387 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76b48f-12be-44f7-a7bf-9c702a45d20d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:22.182031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1394/2796] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:22 2022] PUT /identity/v3/projects/7878e1c913814b36a425747f12f7f1d5/users/0ffe15dd27ea4b7a85a7a735fde02fab/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:22.188549 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.189023 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.189368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.214534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b7b9011a7d4e5cad3f5f630e4f1930'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.221054 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:22.222295 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.269287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b7b9011a7d4e5cad3f5f630e4f1930'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.269919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b7b9011a7d4e5cad3f5f630e4f1930'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.270537 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b7b9011a7d4e5cad3f5f630e4f1930'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.283485 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-33e68d4b-0de0-44d7-8655-6a287b0bfdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b7b9011a7d4e5cad3f5f630e4f1930'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:22.311859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1403/2797] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:21 2022] DELETE /identity/v3/users/64b7b9011a7d4e5cad3f5f630e4f1930 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:22.317770 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434d229-0b61-4777-a890-8ec1b87c412e None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.318055 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434d229-0b61-4777-a890-8ec1b87c412e None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.318334 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434d229-0b61-4777-a890-8ec1b87c412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.348268 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:22.355223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1395/2798] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:22.360594 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-b434d229-0b61-4777-a890-8ec1b87c412e None None] MFA Rules not processed for user `0ffe15dd27ea4b7a85a7a735fde02fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:22.362129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b434d229-0b61-4777-a890-8ec1b87c412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.373926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:22.375466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.442374 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:22.488527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498de1d-e89b-4fd2-8a1e-27adcc3533e5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:22.513134 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1404/2799] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:22.516722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.517101 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.517523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.564181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] MFA Rules not processed for user `2916d230ca9d43fc94dea90a0781973d`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:22.565588 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.576100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:22.576810 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.577086 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.577353 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.647300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1405/2800] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:22.648402 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:22.650437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.670598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:22.672479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:22.685162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1396/2801] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:22.686547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:22.687963 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.708336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3343d-d491-4a42-8413-d5793b4adf90 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:22.721961 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a166485-ee4f-44e3-9e71-fb927dedbca9 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:22.723848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:22.725090 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:22.730959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.730959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.730959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.730959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:22.730959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:22.731808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:22.732673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.733422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.733938 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.736117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.754426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:22.824352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1397/2802] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:22 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:22.829840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:22.832700 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:22.834388 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:22.847376 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1406/2803] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:22.902687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:22.905810 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:22.922733 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a8e1e-1c3d-4683-acc9-001716dc2a64 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:22.943846 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2ccbb-7174-490c-9d03-57b55d7a3bd2 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:22.945516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:22.946368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.947305 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.947747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.949807 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:22.954015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:22.957763 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:22.958419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:22.958695 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:22.958964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] PATH_INFO: `/v3/projects/f6b1c66d2d3e4d539b6969025b526d63` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:22.960567 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b1c66d2d3e4d539b6969025b526d63)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:22.963493 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.043501 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1398/2804] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:22 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:23.049148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:23.066758 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496434d-663e-456e-8d0d-e4f4426a7f08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:23.079468 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:23.080603 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:23.080940 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:23.081225 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:23.082069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:23.083781 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.103901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1399/2805] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:23.107801 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:23.124087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be48f1-4b53-422e-ae8d-3d68a35ef358 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:23.129844 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:23.130512 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:23.130820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:23.131097 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] PATH_INFO: `/v3/projects/2a71799bd15448a2a53652104142aa81/users/0f13075eca424421ba40212b28231beb/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:23.156378 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a71799bd15448a2a53652104142aa81, user_id=0f13075eca424421ba40212b28231beb, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:23.159172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.176731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b1c66d2d3e4d539b6969025b526d63', 'request_id': 'req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.184355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b1c66d2d3e4d539b6969025b526d63', 'request_id': 'req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.284575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1400/2806] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:23 2022] PUT /identity/v3/projects/2a71799bd15448a2a53652104142aa81/users/0f13075eca424421ba40212b28231beb/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:13:23.284575 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:23.285916 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:23.303607 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b1c66d2d3e4d539b6969025b526d63', 'request_id': 'req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.324912 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] The token cache is being invalidate because project f6b1c66d2d3e4d539b6969025b526d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:23.325245 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.326350 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.328211 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1407/2807] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:22 2022] DELETE /identity/v3/projects/f6b1c66d2d3e4d539b6969025b526d63 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:23.328851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:23.330137 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:23.379094 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82c33-316b-476f-a789-f08f57586082 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:23.385122 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:23.385756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:23.386034 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:23.386309 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] PATH_INFO: `/v3/projects/61eea6f99326498db4f8686edd8dacd6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:23.388689 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61eea6f99326498db4f8686edd8dacd6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:23.390618 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.400447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9947498-2f95-4fbb-818b-5ad9ae0f40f3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:23.406659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:23.406659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:23.406659 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:23.406897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:23.407982 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:23.409797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.432517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1408/2808] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:23.432517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:23.432517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:23.446109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2284-6372-45a9-94ba-1e74b0e0ed53 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:23.451129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:23.451764 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:23.452089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:23.452468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] PATH_INFO: `/v3/users/340097ef930344eca597f3ebcb5cfff3` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:23.453624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340097ef930344eca597f3ebcb5cfff3)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:23.455525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.581454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61eea6f99326498db4f8686edd8dacd6', 'request_id': 'req-4342f5bf-abcf-4f80-9044-7fad89f22e05'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.588382 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61eea6f99326498db4f8686edd8dacd6', 'request_id': 'req-4342f5bf-abcf-4f80-9044-7fad89f22e05'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.622523 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:23.679057 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61eea6f99326498db4f8686edd8dacd6', 'request_id': 'req-4342f5bf-abcf-4f80-9044-7fad89f22e05'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.688502 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:23.692345 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] The token cache is being invalidate because project 61eea6f99326498db4f8686edd8dacd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:23.692694 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.693251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.704393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1401/2809] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:23 2022] DELETE /identity/v3/projects/61eea6f99326498db4f8686edd8dacd6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:23.704393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:23.704393 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:23.727243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340097ef930344eca597f3ebcb5cfff3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.795747 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340097ef930344eca597f3ebcb5cfff3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.796935 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340097ef930344eca597f3ebcb5cfff3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.797992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342f5bf-abcf-4f80-9044-7fad89f22e05 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:23.798475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340097ef930344eca597f3ebcb5cfff3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.803299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:23.804006 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:23.804260 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:23.804588 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] PATH_INFO: `/v3/projects/2a71799bd15448a2a53652104142aa81/users/0f13075eca424421ba40212b28231beb/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:23.806746 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a71799bd15448a2a53652104142aa81, user_id=0f13075eca424421ba40212b28231beb, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:23.810569 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:23.811622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340097ef930344eca597f3ebcb5cfff3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:23.825256 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1402/2810] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:23 2022] PUT /identity/v3/projects/2a71799bd15448a2a53652104142aa81/users/0f13075eca424421ba40212b28231beb/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:23.857283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1409/2811] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:23 2022] DELETE /identity/v3/users/340097ef930344eca597f3ebcb5cfff3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:24.479141 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:24.481473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:24.510237 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:24.561258 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f4aa-2f9f-4a65-99ca-9fa6e3f8d214 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:24.567751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:24.625489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:24.626129 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:24.626447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:24.626791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] PATH_INFO: `/v3/projects/19ec8ce0ab29472da136d43f840fbc60` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:24.627982 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ec8ce0ab29472da136d43f840fbc60)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:24.629952 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:24.771184 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ec8ce0ab29472da136d43f840fbc60', 'request_id': 'req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:24.778518 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ec8ce0ab29472da136d43f840fbc60', 'request_id': 'req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:24.846915 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ec8ce0ab29472da136d43f840fbc60', 'request_id': 'req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:24.863022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] The token cache is being invalidate because project 19ec8ce0ab29472da136d43f840fbc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:24.863396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:24.864188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e9cd606-fc51-41b2-b9c1-8cafb1ad9601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:24.869257 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1403/2812] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:24 2022] DELETE /identity/v3/projects/19ec8ce0ab29472da136d43f840fbc60 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:26.223232 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:26.228694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:26.246898 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5495aa-5e98-48d9-b14c-daf4844d2c46 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:26.317291 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:26.317933 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:26.318208 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:26.318480 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] PATH_INFO: `/v3/users/129f3970fcb94cc88a02f4913bba7adc` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:26.319718 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129f3970fcb94cc88a02f4913bba7adc)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:26.322257 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:26.584152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:26.592989 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129f3970fcb94cc88a02f4913bba7adc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:26.696155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129f3970fcb94cc88a02f4913bba7adc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:26.697201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129f3970fcb94cc88a02f4913bba7adc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:26.697662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129f3970fcb94cc88a02f4913bba7adc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:26.713557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129f3970fcb94cc88a02f4913bba7adc'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:26.748687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1410/2813] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:26 2022] DELETE /identity/v3/users/129f3970fcb94cc88a02f4913bba7adc => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:26.754964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:26.754964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:26.754964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:26.779788 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:26.781544 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:26.841120 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:26.849098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1404/2814] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:26.861196 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:26.863917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:26.935353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275a3f4-b924-4e19-aef1-339b1ec19d90 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:26.940673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:26.940673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:26.940673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:26.944226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:26.951566 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:26.953030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:26.963445 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1411/2815] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:27.579709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:27.581388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:27.596017 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5471-14ad-4cfb-8700-8e15c89868d9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:27.611860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:27.612889 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:27.613171 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:27.613442 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] PATH_INFO: `/v3/projects/83866131da794c60b7dada0e099bf2a6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:27.614752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83866131da794c60b7dada0e099bf2a6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:27.616673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:27.763567 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83866131da794c60b7dada0e099bf2a6', 'request_id': 'req-9ec989ec-2d22-4dfe-829a-818f5463c3d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:27.772375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83866131da794c60b7dada0e099bf2a6', 'request_id': 'req-9ec989ec-2d22-4dfe-829a-818f5463c3d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:27.869627 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83866131da794c60b7dada0e099bf2a6', 'request_id': 'req-9ec989ec-2d22-4dfe-829a-818f5463c3d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:27.890272 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] The token cache is being invalidate because project 83866131da794c60b7dada0e099bf2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:27.890738 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:27.891556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:27.898174 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:27.903826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1405/2816] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:27 2022] DELETE /identity/v3/projects/83866131da794c60b7dada0e099bf2a6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:27.909391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5b36d-2edd-4961-b799-f94f15fffeec service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:27.984708 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:27.985508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:27.985890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:27.986288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] PATH_INFO: `/v3/users/0ffe15dd27ea4b7a85a7a735fde02fab` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:27.988800 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffe15dd27ea4b7a85a7a735fde02fab)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:27.990949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:28.178527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffe15dd27ea4b7a85a7a735fde02fab'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:28.256177 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffe15dd27ea4b7a85a7a735fde02fab'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:28.258414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffe15dd27ea4b7a85a7a735fde02fab'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:28.260511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffe15dd27ea4b7a85a7a735fde02fab'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:28.272034 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:28.276872 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-96acea03-e90b-408b-b689-fe036cb4b663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffe15dd27ea4b7a85a7a735fde02fab'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:28.297906 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1412/2817] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:27 2022] DELETE /identity/v3/users/0ffe15dd27ea4b7a85a7a735fde02fab => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:28.764491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:28.766690 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:28.787935 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec989ec-2d22-4dfe-829a-818f5463c3d9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:28.887708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:28.888625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:28.888943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:28.889223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] PATH_INFO: `/v3/projects/7878e1c913814b36a425747f12f7f1d5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:28.890420 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7878e1c913814b36a425747f12f7f1d5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:28.893010 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.101354 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7878e1c913814b36a425747f12f7f1d5', 'request_id': 'req-0202ca55-4b00-444a-b129-3c2db0a52a11'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:29.111223 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7878e1c913814b36a425747f12f7f1d5', 'request_id': 'req-0202ca55-4b00-444a-b129-3c2db0a52a11'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:29.193318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7878e1c913814b36a425747f12f7f1d5', 'request_id': 'req-0202ca55-4b00-444a-b129-3c2db0a52a11'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:29.212589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] The token cache is being invalidate because project 7878e1c913814b36a425747f12f7f1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:29.212974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:29.213925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0202ca55-4b00-444a-b129-3c2db0a52a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:29.215516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1406/2818] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:28 2022] DELETE /identity/v3/projects/7878e1c913814b36a425747f12f7f1d5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:29.220633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.221644 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.221918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.252430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:29.253797 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:29.328407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1413/2819] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:29.336633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.336939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.337198 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.359971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:29.361830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:29.370380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1407/2820] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:29.374622 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:29.387698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d998c-4f18-41e6-b552-128c19cc0148 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:29.394481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:29.395840 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.401522 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.401952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.403421 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:29.403849 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:29.406249 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.447149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1414/2821] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:13:29.452709 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:29.462222 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b5ab4-1c95-4e14-a6f2-3eba2604bc78 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:29.467011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:29.467613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.467894 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.468172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.469511 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:29.471629 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.480708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:29.558581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1408/2822] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:29 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:29.564986 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:29.574395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5418cc-71e5-4692-b934-cea72655dcd1 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:29.635145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:29.635757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.636031 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.636300 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.636969 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:29.638874 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.722368 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1415/2823] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:29 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:29.727177 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:29.739578 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e432daa-cf12-45ff-a91b-12835e54ca42 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:29.744950 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:29.745574 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.745855 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.746134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.746790 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:29.748523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.762879 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1409/2824] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:29.764039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:29.775790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d6712-98fc-4e1f-8db0-dc7259a27eee admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:29.780817 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a223e-86a4-4d9e-b5d5-7bab6af94ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:29.781440 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a223e-86a4-4d9e-b5d5-7bab6af94ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.781715 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a223e-86a4-4d9e-b5d5-7bab6af94ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.781987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a223e-86a4-4d9e-b5d5-7bab6af94ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.782626 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a223e-86a4-4d9e-b5d5-7bab6af94ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:29.784201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a223e-86a4-4d9e-b5d5-7bab6af94ac5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.804407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1416/2825] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:29.806531 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:29.817476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb267923-1a7d-47e7-9e2f-6344f6c1551b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:29.823190 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:29.826760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.826760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.826760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] PATH_INFO: `/v3/projects/636035867ffe4b5eabd93ada356ebab5/users/01670b2b2a134f01afbf9427fadabf92/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:29.842878 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636035867ffe4b5eabd93ada356ebab5, user_id=01670b2b2a134f01afbf9427fadabf92, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:29.845708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:29.971564 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1410/2826] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:29 2022] PUT /identity/v3/projects/636035867ffe4b5eabd93ada356ebab5/users/01670b2b2a134f01afbf9427fadabf92/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:29.984285 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fd84a-da17-4124-9078-635968be70be None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:29.984606 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fd84a-da17-4124-9078-635968be70be None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:29.984884 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fd84a-da17-4124-9078-635968be70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.025819 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-0f5fd84a-da17-4124-9078-635968be70be None None] MFA Rules not processed for user `01670b2b2a134f01afbf9427fadabf92`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:30.044246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0f5fd84a-da17-4124-9078-635968be70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:30.083859 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:30.117777 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1417/2827] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:30.123396 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.194703 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3425-617c-46d0-aece-559bccb57114 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.196539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.196834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.197117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.199943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.200613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.200899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.201172 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.201806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.203681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.226891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] MFA Rules not processed for user `0f13075eca424421ba40212b28231beb`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:30.228062 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:30.294645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1418/2828] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 11:13:30.306789 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.308251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:30.314552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1411/2829] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:30 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:30.319472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.372214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19bb1b-f076-4d07-9607-f6c0902e8839 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.389806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9681da-c5ad-4df6-b229-c489dba13686 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.394595 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.395188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.395462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.395732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.396388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.398336 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.422284 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d237fc491984323aa81865c59d71771', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.424968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.424968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.424968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.425314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:30.464731 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:30.494377 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.495894 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.498462 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1412/2830] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:30 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:30.500149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.505444 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1419/2831] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:13:30.510919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1d1b2-ce12-4f87-a0f2-c1c1cb98132d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.515777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.516415 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.517255 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.517471 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.518121 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.519732 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.530942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1413/2832] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:30.534994 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.557048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269c61-f24f-49a1-a2ab-76a6d8728b31 service glance] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.562067 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b611a9-fddb-4ef1-a5b2-fa2c54e9e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.562673 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b611a9-fddb-4ef1-a5b2-fa2c54e9e217 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.562953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b611a9-fddb-4ef1-a5b2-fa2c54e9e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.563226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b611a9-fddb-4ef1-a5b2-fa2c54e9e217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.563868 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b611a9-fddb-4ef1-a5b2-fa2c54e9e217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.565633 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b611a9-fddb-4ef1-a5b2-fa2c54e9e217 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.577964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1420/2833] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:30.582231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.593159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e7ad4-3b93-45dd-906f-1a2cbf922e46 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.598167 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.598816 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.599388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.599660 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] PATH_INFO: `/v3/projects/578d3d152d3947b8b149cd1b3ae7223c/users/9f82dd95595c4c3ca946e79ea9b5f86a/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.611741 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:30.616456 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578d3d152d3947b8b149cd1b3ae7223c, user_id=9f82dd95595c4c3ca946e79ea9b5f86a, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.620155 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.714500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1414/2834] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:30 2022] PUT /identity/v3/projects/578d3d152d3947b8b149cd1b3ae7223c/users/9f82dd95595c4c3ca946e79ea9b5f86a/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:30.715483 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d64d-75e4-4d81-b37d-ee15383b8542 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.715742 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d64d-75e4-4d81-b37d-ee15383b8542 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.716015 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d64d-75e4-4d81-b37d-ee15383b8542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.749129 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-e489d64d-75e4-4d81-b37d-ee15383b8542 None None] MFA Rules not processed for user `9f82dd95595c4c3ca946e79ea9b5f86a`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:30.750691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-e489d64d-75e4-4d81-b37d-ee15383b8542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:30.836751 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1421/2835] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:30.838281 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:30.851830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.852856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.853336 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.891517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:30.892903 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:30.918820 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ec0f-755b-402f-9aa0-e8e21aecf1e2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:30.923924 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:30.924546 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:30.924834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:30.925108 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:30.925826 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:30.927659 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:30.958239 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1422/2836] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:13:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:31.071406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1415/2837] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:30 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:31.075551 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.087690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0ffca-bd3c-4264-9532-a5966a5a1388 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.145311 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=100 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:31.148951 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.151566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:31.163497 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.164373 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.164628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.164904 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.165541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.167430 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.225126 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec53fb1-0ad1-4fa6-b381-68182892f45d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.230380 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.230992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.231276 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.231554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.275557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1423/2838] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:31 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:13:31.279539 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.289264 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.289527 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbd14c-bc30-4811-98fa-a2c6aff8b557 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.290939 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.294287 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.294879 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.295162 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.295439 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.296176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.297784 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.299644 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1416/2839] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 11:13:31.312176 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1424/2840] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:31.315587 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.329376 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5094361-70bd-49e1-b375-da578b50af08 service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.334153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.334887 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.335105 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.336686 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] PATH_INFO: `/v3/projects/b52b2d0257f74df091dfb57b6785f118/users/c36ff9cda5964386a755a0442f593cec/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.352509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:31.355667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52b2d0257f74df091dfb57b6785f118, user_id=c36ff9cda5964386a755a0442f593cec, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.358350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.470067 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1417/2841] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:31 2022] PUT /identity/v3/projects/b52b2d0257f74df091dfb57b6785f118/users/c36ff9cda5964386a755a0442f593cec/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:31.474806 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.490204 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59d3d5-7f76-4a8f-b497-9c6f4cb9ae0f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.551771 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad07c1-83bb-481c-9605-25102914c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.552442 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad07c1-83bb-481c-9605-25102914c532 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.552729 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad07c1-83bb-481c-9605-25102914c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.553021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad07c1-83bb-481c-9605-25102914c532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.553639 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad07c1-83bb-481c-9605-25102914c532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.556709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad07c1-83bb-481c-9605-25102914c532 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.571780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1425/2842] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:31.573321 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.584582 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ddb3e-9368-4789-a96d-53ea52aeee37 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.590339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.591145 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.591491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.591834 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] PATH_INFO: `/v3/projects/b52b2d0257f74df091dfb57b6785f118/users/c36ff9cda5964386a755a0442f593cec/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.593983 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52b2d0257f74df091dfb57b6785f118, user_id=c36ff9cda5964386a755a0442f593cec, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.596920 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.610165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1418/2843] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:31 2022] PUT /identity/v3/projects/b52b2d0257f74df091dfb57b6785f118/users/c36ff9cda5964386a755a0442f593cec/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:31.621079 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.621434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.621780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.672494 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] MFA Rules not processed for user `c36ff9cda5964386a755a0442f593cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:31.673744 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:31.779113 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1426/2844] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:31.792092 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:31.796743 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:31.866545 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977f36f-1765-4acb-837f-a6a4bc4defee admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:31.870524 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:31.871356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:31.871642 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:31.871908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:31.941346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:31.942797 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:31.953373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1419/2845] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:34.016027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:34.020107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:34.046251 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe9cb-0d69-429c-95a1-375b552cc003 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:34.050978 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:34.052490 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:34.053136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:34.056642 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:34.115224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:34.225418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:34.225418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:34.225418 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1427/2846] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:35.764601 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:35.776857 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a24cb-8de5-403b-b5fd-971042e2fd9f service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:35.781532 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f0835-4468-4902-bf93-8836de76c5e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:35.782285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0835-4468-4902-bf93-8836de76c5e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:35.782671 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0835-4468-4902-bf93-8836de76c5e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:35.783022 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0835-4468-4902-bf93-8836de76c5e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:35.802994 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f0835-4468-4902-bf93-8836de76c5e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:35.805510 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f0835-4468-4902-bf93-8836de76c5e3 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:35.819013 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1420/2847] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:40.727313 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:40.798890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254c03f-4c60-425b-ab4a-1b0ca007d3b3 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:40.804586 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:40.805314 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:40.805595 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:40.805902 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] PATH_INFO: `/v3/users/01670b2b2a134f01afbf9427fadabf92` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:40.807489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01670b2b2a134f01afbf9427fadabf92)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:40.809504 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:41.054414 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01670b2b2a134f01afbf9427fadabf92'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:41.125831 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01670b2b2a134f01afbf9427fadabf92'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:41.126517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01670b2b2a134f01afbf9427fadabf92'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:41.127124 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01670b2b2a134f01afbf9427fadabf92'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:41.135433 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01670b2b2a134f01afbf9427fadabf92'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:41.154737 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1428/2848] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:40 2022] DELETE /identity/v3/users/01670b2b2a134f01afbf9427fadabf92 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:41.162189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb36d-f934-41cf-a12e-56b0c42622ab None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:41.162189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb36d-f934-41cf-a12e-56b0c42622ab None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:41.162189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb36d-f934-41cf-a12e-56b0c42622ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:41.179465 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9d6fb36d-f934-41cf-a12e-56b0c42622ab None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:41.180699 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9d6fb36d-f934-41cf-a12e-56b0c42622ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:41.241149 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1421/2849] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:41.252645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:41.254035 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:41.312400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea6b6b-3b5f-4d5e-aa09-8f386eb5e572 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:41.315875 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:41.316515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:41.322664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:41.322664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:41.326270 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:41.327679 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:41.337434 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1429/2850] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:41.541637 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:41.541927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:41.542202 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:41.561638 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] MFA Rules not processed for user `2916d230ca9d43fc94dea90a0781973d`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:41.562926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:41.577409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:41.621890 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1422/2851] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:41.801369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:41.801857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:41.819395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:41.824191 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc173e3-fd27-406b-96c7-416b1b90c647 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:41.829180 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:41.829919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:41.838419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:41.838419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] PATH_INFO: `/v3/projects/636035867ffe4b5eabd93ada356ebab5` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:41.838419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=636035867ffe4b5eabd93ada356ebab5)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:41.839107 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:41.898628 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:41.900029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:41.911716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f5c2-faab-4611-9ef2-3eb81812be78 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:41.915346 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:41.915943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:41.916220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:41.916555 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:41.918200 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:41.927850 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:41.930085 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:41.938148 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1423/2852] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:41.983511 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636035867ffe4b5eabd93ada356ebab5', 'request_id': 'req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:41.989964 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636035867ffe4b5eabd93ada356ebab5', 'request_id': 'req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.074830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636035867ffe4b5eabd93ada356ebab5', 'request_id': 'req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.086235 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] The token cache is being invalidate because project 636035867ffe4b5eabd93ada356ebab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:42.086533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.087187 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.088799 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1430/2853] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:41 2022] DELETE /identity/v3/projects/636035867ffe4b5eabd93ada356ebab5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:42.092865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:42.105523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3488a-7005-4008-8eb2-780c2d59c724 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:42.164266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:42.165059 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:42.165323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:42.165597 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] PATH_INFO: `/v3/users/9f82dd95595c4c3ca946e79ea9b5f86a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:42.166747 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f82dd95595c4c3ca946e79ea9b5f86a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:42.168799 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:42.333614 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f82dd95595c4c3ca946e79ea9b5f86a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.417513 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f82dd95595c4c3ca946e79ea9b5f86a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.418401 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f82dd95595c4c3ca946e79ea9b5f86a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.419191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f82dd95595c4c3ca946e79ea9b5f86a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.427707 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f82dd95595c4c3ca946e79ea9b5f86a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:42.448613 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1424/2854] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:42 2022] DELETE /identity/v3/users/9f82dd95595c4c3ca946e79ea9b5f86a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:42.876532 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:42.878283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:42.892050 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeec4c8-a29c-44a8-a1b3-7fe938f6b7ff admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:42.953785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:42.954417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:42.954694 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:42.954965 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] PATH_INFO: `/v3/projects/578d3d152d3947b8b149cd1b3ae7223c` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:42.956066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578d3d152d3947b8b149cd1b3ae7223c)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:42.958011 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:43.063928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578d3d152d3947b8b149cd1b3ae7223c', 'request_id': 'req-18868812-3813-40f5-ba2a-4ebcef5f4cb3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.070117 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578d3d152d3947b8b149cd1b3ae7223c', 'request_id': 'req-18868812-3813-40f5-ba2a-4ebcef5f4cb3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.131240 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578d3d152d3947b8b149cd1b3ae7223c', 'request_id': 'req-18868812-3813-40f5-ba2a-4ebcef5f4cb3'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.142608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] The token cache is being invalidate because project 578d3d152d3947b8b149cd1b3ae7223c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:43.142838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.143468 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.145014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1431/2855] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:42 2022] DELETE /identity/v3/projects/578d3d152d3947b8b149cd1b3ae7223c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:43.149697 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:43.151093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:43.163811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d2811-1d5f-427b-8209-ec2d747bc4e6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:43.193710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:43.221943 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:43.222625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:43.222903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:43.223178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] PATH_INFO: `/v3/users/c36ff9cda5964386a755a0442f593cec` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:43.224576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36ff9cda5964386a755a0442f593cec)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:43.226472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:43.406598 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36ff9cda5964386a755a0442f593cec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.506232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36ff9cda5964386a755a0442f593cec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.506845 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36ff9cda5964386a755a0442f593cec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.507447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36ff9cda5964386a755a0442f593cec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.515055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5dc92de-093e-4cf6-af0f-cb781b17115a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36ff9cda5964386a755a0442f593cec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:43.532107 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1425/2856] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:13:43 2022] DELETE /identity/v3/users/c36ff9cda5964386a755a0442f593cec => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:44.042736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.044253 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:44.061991 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18868812-3813-40f5-ba2a-4ebcef5f4cb3 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.073713 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:44.123794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.124454 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.124732 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.125006 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] PATH_INFO: `/v3/projects/b52b2d0257f74df091dfb57b6785f118` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.126111 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52b2d0257f74df091dfb57b6785f118)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.128069 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:44.251044 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52b2d0257f74df091dfb57b6785f118', 'request_id': 'req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:44.257495 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52b2d0257f74df091dfb57b6785f118', 'request_id': 'req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:44.331027 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52b2d0257f74df091dfb57b6785f118', 'request_id': 'req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:44.341959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] The token cache is being invalidate because project b52b2d0257f74df091dfb57b6785f118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:13:44.342246 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:44.342856 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-123462a7-7ba4-4d5e-b8dd-0c63474ea66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:13:44.344361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1432/2857] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:13:44 2022] DELETE /identity/v3/projects/b52b2d0257f74df091dfb57b6785f118 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:44.349386 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.349849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.349962 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.370244 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:44.371426 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:44.428708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1426/2858] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:44.437179 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.437466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.437822 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.457988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:44.459229 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:44.468464 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1433/2859] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:44.472714 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.483698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47730340-a675-4740-bac5-6a0cb989eb71 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.488284 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.488908 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.489188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.489489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.490130 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:13:44.490431 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.492039 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:44.508093 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1427/2860] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:13:44.512985 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.523890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bc3d1-1c8e-44f6-94fe-0ce1c0ba7ed6 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.528897 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.529555 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.530056 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.530332 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.530987 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.532937 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:44.630188 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1434/2861] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:13:44 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:44.634275 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.644485 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85beda1-7c60-4d9d-bc5d-27e2a02536ba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.680556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:44.704710 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.705316 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.705594 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.705864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.706489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.708500 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:44.820701 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1428/2862] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:13:44 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:13:44.825521 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.837186 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e269-25f3-4ed9-beb7-2187493ce4d5 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.842474 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.843096 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.843355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.843624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.844422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.846167 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:44.860266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1435/2863] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:13:44.861408 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.871675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaeb2e-b853-446a-8261-26dcae29123b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.876339 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d932ded-6977-4aa2-9c85-63505a68c5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.876942 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932ded-6977-4aa2-9c85-63505a68c5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.877217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932ded-6977-4aa2-9c85-63505a68c5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.877489 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d932ded-6977-4aa2-9c85-63505a68c5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.878159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d932ded-6977-4aa2-9c85-63505a68c5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.879736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d932ded-6977-4aa2-9c85-63505a68c5ec admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:44.891033 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1429/2864] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:13:44.895381 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:44.906175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a697-c520-48f2-8836-605a0052d3da admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:44.910928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:44.911565 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:44.911841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:44.912213 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] PATH_INFO: `/v3/projects/836d0956df514a7b99925f0496ed274c/users/f410bf9d485e49b9ae70d21126fa329c/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:44.926885 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=836d0956df514a7b99925f0496ed274c, user_id=f410bf9d485e49b9ae70d21126fa329c, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:44.929550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:45.000967 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1436/2865] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:13:44 2022] PUT /identity/v3/projects/836d0956df514a7b99925f0496ed274c/users/f410bf9d485e49b9ae70d21126fa329c/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:13:45.006992 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ff7-ace8-42d8-a29c-eedb9b0bb6b7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:45.007849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ff7-ace8-42d8-a29c-eedb9b0bb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:45.008482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ff7-ace8-42d8-a29c-eedb9b0bb6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:45.035580 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ffea1ff7-ace8-42d8-a29c-eedb9b0bb6b7 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:45.037961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ffea1ff7-ace8-42d8-a29c-eedb9b0bb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:45.109958 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1430/2866] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:45.120578 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:45.123460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:45.181871 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:45.193915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed5155-e1c0-4bb9-ab25-ee860905c89f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:45.198303 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:45.199090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:45.199492 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:45.199774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:45.209358 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:45.210873 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:45.224641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1437/2867] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:45.346772 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504206bf-85ff-48de-8cb1-b1f65e0971fb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:45.347139 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504206bf-85ff-48de-8cb1-b1f65e0971fb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:45.347479 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504206bf-85ff-48de-8cb1-b1f65e0971fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:45.368218 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-504206bf-85ff-48de-8cb1-b1f65e0971fb None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:45.369435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-504206bf-85ff-48de-8cb1-b1f65e0971fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:45.437071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1431/2868] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:45.450161 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:45.451591 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:45.536517 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db2a10-aaef-487f-9ba8-174a76b48bb9 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:45.544171 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:45.544949 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:45.545477 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:45.545664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:45.559911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:45.562290 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:45.573141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1438/2869] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:13:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:13:46.771883 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df8d87-824b-43b6-ab5a-5dd066a685ac None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:46.773098 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df8d87-824b-43b6-ab5a-5dd066a685ac None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:46.773388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df8d87-824b-43b6-ab5a-5dd066a685ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:46.827466 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e3df8d87-824b-43b6-ab5a-5dd066a685ac None None] MFA Rules not processed for user `f410bf9d485e49b9ae70d21126fa329c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:46.829214 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e3df8d87-824b-43b6-ab5a-5dd066a685ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:46.900882 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:46.926350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1432/2870] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:46.938498 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:13:46.944172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:47.118882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8421-2d50-4248-9f78-7cc81cff399f service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:13:47.122959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:13:47.123706 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:47.123954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:47.125019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:47.142975 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:13:47.144891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:13:47.157738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1439/2871] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:13:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:13:49.089119 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:13:49.089830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:13:49.089830 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:13:49.114995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] MFA Rules not processed for user `f410bf9d485e49b9ae70d21126fa329c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:13:49.116232 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:13:49.124352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1433/2872] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:13:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:13:57.151968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=64 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:13:59.104948 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:10.168992 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:10.178710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44203-93d0-4d41-8f65-849e265e264a service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:10.182948 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:10.183716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:10.184066 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:10.184447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:10.186355 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:10.255709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:10.257263 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2eab8c-6e7c-4b40-ab6d-9c95a621bbe6 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:10.267331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1440/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:14:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:14:10.574289 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:10.576062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:10.672562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a183d-4f4d-46c9-9961-9e06f8f3f3af None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:10.677795 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:10.678400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:10.678679 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:10.678953 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:10.680729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:10.693473 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:10.695082 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:10.705730 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1434/2874] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:14:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:14:11.647032 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fcc37-ce85-437e-96c7-0e073b2f4791 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:11.653140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fcc37-ce85-437e-96c7-0e073b2f4791 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:11.653140 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fcc37-ce85-437e-96c7-0e073b2f4791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:11.666958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-342fcc37-ce85-437e-96c7-0e073b2f4791 None None] MFA Rules not processed for user `f410bf9d485e49b9ae70d21126fa329c`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:14:11.668159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-342fcc37-ce85-437e-96c7-0e073b2f4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:11.675248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1441/2875] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:14:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:14:12.604162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:12.605789 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:12.737231 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52387a-8553-4d81-945c-02e6920f71c5 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:12.744349 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:12.745670 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:12.746715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:12.746715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:12.748215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:12.776782 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:12.778472 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:12.795815 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1435/2876] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:14:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:14:21.660805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=33 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:22.788081 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:33.552411 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5394b-f0c9-4323-a48d-bafd776bc9ba None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:33.552869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5394b-f0c9-4323-a48d-bafd776bc9ba None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:33.552988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5394b-f0c9-4323-a48d-bafd776bc9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:33.572466 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-4cf5394b-f0c9-4323-a48d-bafd776bc9ba None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:14:33.573654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-4cf5394b-f0c9-4323-a48d-bafd776bc9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:33.580844 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1442/2877] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Sep 15 11:14:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:14:33.603220 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:33.615162 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a76ea-3268-470b-9be1-51b4dff49366 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:33.621178 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:33.621771 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:33.622047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:33.622323 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:33.630251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:33.631809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:33.639895 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1436/2878] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:14:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:14:43.567136 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:43.636759 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:51.239417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:51.239918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:51.240014 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:51.260341 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:14:51.261501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:51.268657 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1443/2879] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 15 11:14:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:14:51.280558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:51.290974 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685fc30-0bbd-4709-bc39-6b75ff9d1df7 service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:51.295769 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:51.296385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:51.296664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:51.296937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:51.304831 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:51.307100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:51.314936 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1437/2880] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:14:54.369199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:54.382242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bef51-0d7e-478c-9be2-de8c053cdd26 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:54.387288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:54.387917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:54.388201 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:54.388515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] PATH_INFO: `/v3/users/f410bf9d485e49b9ae70d21126fa329c` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:54.389670 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f410bf9d485e49b9ae70d21126fa329c)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:54.391557 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:54.550190 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f410bf9d485e49b9ae70d21126fa329c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:54.613550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f410bf9d485e49b9ae70d21126fa329c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:54.614159 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f410bf9d485e49b9ae70d21126fa329c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:54.614750 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f410bf9d485e49b9ae70d21126fa329c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:54.622687 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-368bdddc-661f-4c4d-85f5-1f115aca56ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f410bf9d485e49b9ae70d21126fa329c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:54.640216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1444/2881] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:14:54 2022] DELETE /identity/v3/users/f410bf9d485e49b9ae70d21126fa329c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:14:54.889565 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:54.900297 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d91459-fc22-4bc1-b92d-e49cae23d383 service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:54.958128 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:54.958755 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:54.959035 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:54.959311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] PATH_INFO: `/v3/projects/836d0956df514a7b99925f0496ed274c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:54.960454 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836d0956df514a7b99925f0496ed274c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:54.962350 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.060127 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836d0956df514a7b99925f0496ed274c', 'request_id': 'req-a53e3f1b-200e-4383-b245-a68409a08604'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:55.066352 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836d0956df514a7b99925f0496ed274c', 'request_id': 'req-a53e3f1b-200e-4383-b245-a68409a08604'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:55.128159 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836d0956df514a7b99925f0496ed274c', 'request_id': 'req-a53e3f1b-200e-4383-b245-a68409a08604'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:55.139581 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] The token cache is being invalidate because project 836d0956df514a7b99925f0496ed274c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:14:55.139811 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:55.140483 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a53e3f1b-200e-4383-b245-a68409a08604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:14:55.142046 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1438/2882] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:14:54 2022] DELETE /identity/v3/projects/836d0956df514a7b99925f0496ed274c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:14:55.146848 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.147181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.147458 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.169041 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:14:55.170295 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:55.230780 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1445/2883] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:14:55.238959 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.239246 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.239576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.260373 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:14:55.262534 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:55.270902 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1439/2884] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:14:55.275122 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.285932 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df606f8-c6d1-4b43-b370-c7fb58352233 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.290650 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.291280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.291554 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.291823 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.293097 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:14:55.293397 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.295223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.307541 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1446/2885] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:14:55.311558 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.321036 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b968-42ee-4d61-bc25-5169c6879073 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.326521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.327116 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.327397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.327675 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.328299 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.330212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.428209 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1440/2886] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:14:55 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:14:55.432407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.442923 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113055e-363a-47f6-9e27-51e6255066ac admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.490258 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:55.499575 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.500953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.500953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.500953 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.501370 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.503283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.587977 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1447/2887] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:14:55 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:14:55.592150 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.602552 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bba1b-ef83-4623-b5af-2d4f17d44425 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.607368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.607964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.608236 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.608541 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.609201 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.610774 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.621181 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1441/2888] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:14:55.625123 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.635224 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470281d6-c0fe-40c5-aa27-89a33bed4dba admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.640880 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5d8ba-4bac-4cca-838a-d74619bb2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.641486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5d8ba-4bac-4cca-838a-d74619bb2fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.641768 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5d8ba-4bac-4cca-838a-d74619bb2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.642042 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5d8ba-4bac-4cca-838a-d74619bb2fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.642676 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5d8ba-4bac-4cca-838a-d74619bb2fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.644371 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5d8ba-4bac-4cca-838a-d74619bb2fa5 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.655266 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1448/2889] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:14:55.658988 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.668777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21fb5-6215-442f-aea5-a1e509ec454e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.673215 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.673848 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.674123 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.674400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] PATH_INFO: `/v3/projects/ad29ed27f57d44f0b46cb80593048d5c/users/5fa7422cf2bf41b0b5cb3544fe1c9493/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.689074 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad29ed27f57d44f0b46cb80593048d5c, user_id=5fa7422cf2bf41b0b5cb3544fe1c9493, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.691608 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.748069 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1442/2890] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:14:55 2022] PUT /identity/v3/projects/ad29ed27f57d44f0b46cb80593048d5c/users/5fa7422cf2bf41b0b5cb3544fe1c9493/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:14:55.758400 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.758682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.758957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.786716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] MFA Rules not processed for user `5fa7422cf2bf41b0b5cb3544fe1c9493`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:14:55.787918 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:55.851794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1449/2891] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:14:55.863406 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:14:55.865137 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:14:55.879997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:14:55.924100 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391636c0-d708-4ad6-99c7-8be8a6c4b08d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:14:55.927922 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d74e0-942b-489b-a554-a52d9e72f9a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:14:55.928566 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d74e0-942b-489b-a554-a52d9e72f9a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:14:55.928849 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d74e0-942b-489b-a554-a52d9e72f9a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:14:55.929117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d74e0-942b-489b-a554-a52d9e72f9a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:14:55.944657 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d74e0-942b-489b-a554-a52d9e72f9a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:14:55.946015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d74e0-942b-489b-a554-a52d9e72f9a2 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:14:55.955247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1443/2892] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:14:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:15:05.848957 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:05.958863 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=20 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:30.522893 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:30.583625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aeb6d2-7d44-4790-9d36-00fb8933d37b None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:30.588276 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:30.588929 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:30.589206 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:30.589481 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] PATH_INFO: `/v3/users/5fa7422cf2bf41b0b5cb3544fe1c9493` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:30.590609 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa7422cf2bf41b0b5cb3544fe1c9493)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:30.592515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:30.762216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa7422cf2bf41b0b5cb3544fe1c9493'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:30.823450 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa7422cf2bf41b0b5cb3544fe1c9493'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:30.824086 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa7422cf2bf41b0b5cb3544fe1c9493'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:30.824724 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa7422cf2bf41b0b5cb3544fe1c9493'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:30.833643 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa7422cf2bf41b0b5cb3544fe1c9493'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:30.853149 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1450/2893] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:15:30 2022] DELETE /identity/v3/users/5fa7422cf2bf41b0b5cb3544fe1c9493 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:30.857560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:30.858047 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:30.858153 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:30.877796 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:30.878997 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:30.937356 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1444/2894] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:30.947039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:30.948465 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:31.004357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d81659-4421-44ba-a357-32e0832b937f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:31.007958 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7238e26-6d24-4058-b640-38dad03ec69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:31.008602 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7238e26-6d24-4058-b640-38dad03ec69d service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:31.008881 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7238e26-6d24-4058-b640-38dad03ec69d service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:31.009155 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7238e26-6d24-4058-b640-38dad03ec69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:31.018689 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7238e26-6d24-4058-b640-38dad03ec69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:31.020105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7238e26-6d24-4058-b640-38dad03ec69d service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:31.029286 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1451/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:15:31.439176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:31.440625 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:31.452945 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761922e9-6cc9-49de-b89e-fdc6f4ccfe51 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:31.458453 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:31.459110 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:31.459394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:31.459667 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] PATH_INFO: `/v3/projects/ad29ed27f57d44f0b46cb80593048d5c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:31.460919 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad29ed27f57d44f0b46cb80593048d5c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:31.462851 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:31.569294 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad29ed27f57d44f0b46cb80593048d5c', 'request_id': 'req-0489ba92-e3bc-44b4-b3fd-95f43fd90847'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:31.575318 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad29ed27f57d44f0b46cb80593048d5c', 'request_id': 'req-0489ba92-e3bc-44b4-b3fd-95f43fd90847'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:31.654365 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad29ed27f57d44f0b46cb80593048d5c', 'request_id': 'req-0489ba92-e3bc-44b4-b3fd-95f43fd90847'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:31.666621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] The token cache is being invalidate because project ad29ed27f57d44f0b46cb80593048d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:15:31.666914 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:31.667554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0489ba92-e3bc-44b4-b3fd-95f43fd90847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:31.669072 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1445/2896] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:15:31 2022] DELETE /identity/v3/projects/ad29ed27f57d44f0b46cb80593048d5c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:31.674624 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:31.675085 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:31.675199 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:31.694534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:31.695714 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:31.712668 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:31.755641 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1452/2897] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:31.764770 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:31.765079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:31.765351 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:31.785425 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:31.786599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:31.794631 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1446/2898] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:31.799508 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:31.809153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51717ed4-a7f6-4b3a-9fa6-0bfc375f817c None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:31.813757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:31.814349 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:31.814630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:31.814900 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:31.815536 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:15:31.815834 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:31.817447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:31.829774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1453/2899] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:15:31.833929 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:31.843055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ba52-570d-497e-9285-7c35bc8b79e3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:31.848860 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:31.849447 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:31.849724 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:31.849999 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:31.850647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:31.852632 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:31.929762 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1447/2900] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:15:31 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:15:31.933890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:31.943656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa4163-f070-4466-91e1-ff3a3f6c1d12 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:31.999556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:32.000697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:32.000972 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:32.001248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:32.001882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:32.003785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:32.071649 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1454/2901] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:15:31 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:15:32.075734 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:32.086937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bcbd-c289-4c8a-802b-c25268b669f8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:32.091550 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:32.092138 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:32.095535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:32.095535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:32.095535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:32.095535 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:32.105409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1448/2902] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:15:32.109399 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:32.119580 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe5b99-0093-4888-a889-e497d2ec9a6a admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:32.124175 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0149b-d6e8-46da-8f7c-3b00541e464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:32.124805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0149b-d6e8-46da-8f7c-3b00541e464a admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:32.125613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0149b-d6e8-46da-8f7c-3b00541e464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:32.125890 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0149b-d6e8-46da-8f7c-3b00541e464a admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:32.126518 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0149b-d6e8-46da-8f7c-3b00541e464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:32.128082 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0149b-d6e8-46da-8f7c-3b00541e464a admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:32.138785 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1455/2903] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:15:32.143663 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:32.153617 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16893deb-3c34-4db0-806e-419a887b5b3b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:32.158740 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:32.159400 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:32.159681 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:32.159956 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] PATH_INFO: `/v3/projects/4d742b3de6594999a22262b3c8b5f1d0/users/13a64a4aa44e4e4a8c03456d1ead9d08/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:32.174306 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d742b3de6594999a22262b3c8b5f1d0, user_id=13a64a4aa44e4e4a8c03456d1ead9d08, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:32.176996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:32.245926 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1449/2904] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:15:32 2022] PUT /identity/v3/projects/4d742b3de6594999a22262b3c8b5f1d0/users/13a64a4aa44e4e4a8c03456d1ead9d08/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:32.257121 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:32.257422 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:32.257682 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:32.285766 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] MFA Rules not processed for user `13a64a4aa44e4e4a8c03456d1ead9d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:32.287043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:32.351514 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1456/2905] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:32.362736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:32.364421 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:32.386589 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:32.421230 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342c1b2-cac4-4176-879f-3ec36048c305 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:32.425508 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7658f-56a7-4bd6-8e0e-ae3c91c91b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:32.426114 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7658f-56a7-4bd6-8e0e-ae3c91c91b17 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:32.426397 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7658f-56a7-4bd6-8e0e-ae3c91c91b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:32.426673 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7658f-56a7-4bd6-8e0e-ae3c91c91b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:32.435208 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7658f-56a7-4bd6-8e0e-ae3c91c91b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:32.436668 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7658f-56a7-4bd6-8e0e-ae3c91c91b17 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:32.446071 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1450/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:15:42.348599 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:42.700106 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=17 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:43.932061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:43.997352 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acb41b-8926-4327-a2ad-e4687447d475 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:44.001960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:44.003255 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:44.003534 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:44.003805 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] PATH_INFO: `/v3/users/13a64a4aa44e4e4a8c03456d1ead9d08` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:44.004981 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a64a4aa44e4e4a8c03456d1ead9d08)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:44.006920 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:44.228395 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a64a4aa44e4e4a8c03456d1ead9d08'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:44.291502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a64a4aa44e4e4a8c03456d1ead9d08'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:44.292281 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a64a4aa44e4e4a8c03456d1ead9d08'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:44.293025 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a64a4aa44e4e4a8c03456d1ead9d08'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:44.304026 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a64a4aa44e4e4a8c03456d1ead9d08'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:44.325807 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1457/2907] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:15:43 2022] DELETE /identity/v3/users/13a64a4aa44e4e4a8c03456d1ead9d08 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:44.330205 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:44.331996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:44.331996 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:44.350977 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:44.352203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:44.418806 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1451/2908] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:44.429021 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:44.430556 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:44.496712 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7fe6-7216-4ec5-889a-ed376c6af406 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:44.500515 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc9f8-ba84-4ea6-8a13-23af062ddc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:44.501133 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc9f8-ba84-4ea6-8a13-23af062ddc86 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:44.501543 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc9f8-ba84-4ea6-8a13-23af062ddc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:44.501669 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc9f8-ba84-4ea6-8a13-23af062ddc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:44.513774 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc9f8-ba84-4ea6-8a13-23af062ddc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:44.515680 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc9f8-ba84-4ea6-8a13-23af062ddc86 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:44.536841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1458/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:15:45.125388 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.126818 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:45.140527 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7f173-998b-4c50-b1ad-9d52def2c404 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.146048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.146731 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.147016 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.147296 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] PATH_INFO: `/v3/projects/4d742b3de6594999a22262b3c8b5f1d0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.148469 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d742b3de6594999a22262b3c8b5f1d0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.150562 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:45.283368 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d742b3de6594999a22262b3c8b5f1d0', 'request_id': 'req-9f234792-c41b-4012-8cb2-05dca7ebf1e8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:45.290749 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d742b3de6594999a22262b3c8b5f1d0', 'request_id': 'req-9f234792-c41b-4012-8cb2-05dca7ebf1e8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:45.359995 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d742b3de6594999a22262b3c8b5f1d0', 'request_id': 'req-9f234792-c41b-4012-8cb2-05dca7ebf1e8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:45.372514 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] The token cache is being invalidate because project 4d742b3de6594999a22262b3c8b5f1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:15:45.372822 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:45.373477 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9f234792-c41b-4012-8cb2-05dca7ebf1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:15:45.375287 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1452/2910] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:15:45 2022] DELETE /identity/v3/projects/4d742b3de6594999a22262b3c8b5f1d0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:45.381109 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.381757 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.381864 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.402688 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:45.403921 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:45.422460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:45.469172 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1459/2911] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:45.479459 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.479757 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.480031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.500812 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:45.501998 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:45.511516 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1453/2912] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:45.515845 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.527391 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dc8fe-e785-4a8b-a46f-223351bb469f None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.532007 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.532741 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.533084 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.534145 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.534919 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 11:15:45.535367 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.537152 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:45.554502 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1460/2913] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Sep 15 11:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 11:15:45.559029 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.568134 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5e841-04b4-4f2c-9844-8b336b483e06 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.572760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.573385 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.573661 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.573930 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.574559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.576523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:45.672488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1454/2914] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:15:45 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:15:45.676960 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.686786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1f83-97be-407b-9a1d-1eea55f134ba admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.745837 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.746460 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.746738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.747012 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.747660 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.749630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:45.883389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1461/2915] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:15:45 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:15:45.885482 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.897252 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96046b2-cf7e-4514-9203-8fab886176a0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.902135 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.902842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.903183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.903570 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.904266 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.905968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:45.919727 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1455/2916] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 11:15:45.921656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.934052 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af84ba-ab7b-4871-bcd9-025a9451ee46 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.940403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f808b8-4570-4905-9a06-a4bab1143226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.941168 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f808b8-4570-4905-9a06-a4bab1143226 admin admin] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.941449 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f808b8-4570-4905-9a06-a4bab1143226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.941723 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f808b8-4570-4905-9a06-a4bab1143226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.942489 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f808b8-4570-4905-9a06-a4bab1143226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.944254 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f808b8-4570-4905-9a06-a4bab1143226 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:45.955078 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1462/2917] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:15:45.959499 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:45.970087 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c7d3-71c9-4813-b717-b018b416271f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:45.975056 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:45.975708 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:45.975984 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:45.976254 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] PATH_INFO: `/v3/projects/82df07f4a560481790da3c088446281a/users/024c3c41783a48e4bc2d65e198ebcb0c/roles/35a5b624e6db4cad87cd57e909000815` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:45.991650 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82df07f4a560481790da3c088446281a, user_id=024c3c41783a48e4bc2d65e198ebcb0c, role_id=35a5b624e6db4cad87cd57e909000815)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:45.994335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:46.065986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1456/2918] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:15:45 2022] PUT /identity/v3/projects/82df07f4a560481790da3c088446281a/users/024c3c41783a48e4bc2d65e198ebcb0c/roles/35a5b624e6db4cad87cd57e909000815 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:46.071135 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda888-35d7-4936-80b9-bf59d30c5212 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:46.071419 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda888-35d7-4936-80b9-bf59d30c5212 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:46.071691 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fda888-35d7-4936-80b9-bf59d30c5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:46.097882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-36fda888-35d7-4936-80b9-bf59d30c5212 None None] MFA Rules not processed for user `3ee61658b90f47ef8962c8e9a5f6c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:46.097882 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-36fda888-35d7-4936-80b9-bf59d30c5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:46.171416 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1463/2919] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:46.182664 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:46.189041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:46.208261 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:46.256526 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78a981-33dc-49f7-b9db-376d72ea2dd6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:46.262270 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:46.262897 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:46.264199 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:46.264556 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:46.276211 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:46.277756 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:46.289461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1457/2920] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:15:51.970362 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:51.971309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:51.971309 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.007861 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.auth.core [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] MFA Rules not processed for user `024c3c41783a48e4bc2d65e198ebcb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:52.009850 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:52.048106 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:52.108569 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1464/2921] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:52.113197 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:52.123314 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17730fb-15b7-44ed-b0b4-523df0018cab service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:52.128452 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:52.129001 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:52.129285 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:52.129559 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.130189 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:52.132125 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:52.255051 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1458/2922] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Sep 15 11:15:52 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 11:15:52.258749 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:52.270613 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bb782-825e-4917-aaa2-e413b345e399 None None] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:52.342005 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:52.342665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:52.342944 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:52.343216 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] PATH_INFO: `/v3/users` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.343914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:52.345947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:52.429630 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1465/2923] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Sep 15 11:15:52 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 11:15:52.433925 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:52.445417 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec4a06-a31f-46b8-9747-e70bfb66dc80 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:52.450729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:52.451291 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:52.451576 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:52.451842 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.452696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:52.454183 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:52.469347 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1459/2924] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:15:52.472665 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:52.483361 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aaa160-e990-40a6-9322-37246a8fdb8c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:52.489369 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:52.490131 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:52.490475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:52.490851 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] PATH_INFO: `/v3/projects/5198b6241f2f4e969f0f8979d4d76f81/users/5049ff936c354950a1e7865f0674ad55/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.509608 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5198b6241f2f4e969f0f8979d4d76f81, user_id=5049ff936c354950a1e7865f0674ad55, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:52.510524 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:52.591447 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1466/2925] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:15:52 2022] PUT /identity/v3/projects/5198b6241f2f4e969f0f8979d4d76f81/users/5049ff936c354950a1e7865f0674ad55/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:52.595583 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:52.606980 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dca6f-abec-430d-a2ae-cbbd0da0f67b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:52.667461 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b15ea-f3fa-45ea-b13d-1532043cdb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:52.668102 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b15ea-f3fa-45ea-b13d-1532043cdb29 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:52.668432 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b15ea-f3fa-45ea-b13d-1532043cdb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:52.668712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b15ea-f3fa-45ea-b13d-1532043cdb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.669384 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b15ea-f3fa-45ea-b13d-1532043cdb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:52.670966 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b15ea-f3fa-45ea-b13d-1532043cdb29 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:52.681599 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1460/2926] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 15 11:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 11:15:52.685698 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:52.696869 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a757e-aa3a-49ff-ba74-926c0d4597e0 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:52.701722 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:52.702318 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:52.702662 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:52.702947 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] PATH_INFO: `/v3/projects/5198b6241f2f4e969f0f8979d4d76f81/users/5049ff936c354950a1e7865f0674ad55/roles/685ec3352bf148c5ad1012dcd25dc881` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:52.705962 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5198b6241f2f4e969f0f8979d4d76f81, user_id=5049ff936c354950a1e7865f0674ad55, role_id=685ec3352bf148c5ad1012dcd25dc881)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:52.708100 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:52.719716 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1467/2927] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Sep 15 11:15:52 2022] PUT /identity/v3/projects/5198b6241f2f4e969f0f8979d4d76f81/users/5049ff936c354950a1e7865f0674ad55/roles/685ec3352bf148c5ad1012dcd25dc881 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:15:53.987165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c950b-6494-4267-af18-8f7201e0c94a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:53.987685 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c950b-6494-4267-af18-8f7201e0c94a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:53.987791 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c950b-6494-4267-af18-8f7201e0c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:54.011217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-844c950b-6494-4267-af18-8f7201e0c94a None None] MFA Rules not processed for user `b4ecd6883cc643a59598254944fe52f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:54.011217 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-844c950b-6494-4267-af18-8f7201e0c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:54.078711 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1461/2928] 10.222.0.26 () {58 vars in 967 bytes} [Thu Sep 15 11:15:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:54.250292 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:54.252790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:54.327061 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352bf5b-55bf-4fa9-85cc-4f704fccbd3c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:54.333692 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8107c052569f41c3a0d7f188d1642f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:54.334525 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:54.334952 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:54.335528 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:54.345068 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:54.348098 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:54.354973 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:54.364841 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1468/2929] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Sep 15 11:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 11:15:58.858519 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00d82e-2543-4c61-b528-3ba4b32d4866 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:58.859509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00d82e-2543-4c61-b528-3ba4b32d4866 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:58.859968 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00d82e-2543-4c61-b528-3ba4b32d4866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:58.906777 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8c00d82e-2543-4c61-b528-3ba4b32d4866 None None] MFA Rules not processed for user `5049ff936c354950a1e7865f0674ad55`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:15:58.908876 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8c00d82e-2543-4c61-b528-3ba4b32d4866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:58.934865 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:15:59.010055 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1462/2930] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:15:59.024070 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:15:59.025654 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:15:59.122265 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f04b11-cbc6-49ad-be54-31ff1840095c service swift] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:15:59.126696 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:15:59.127457 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:15:59.127739 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:15:59.128073 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:15:59.192030 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:15:59.194138 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:15:59.205160 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1469/2931] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:16:01.995467 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:01.996509 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:01.997011 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:02.021633 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] MFA Rules not processed for user `024c3c41783a48e4bc2d65e198ebcb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 11:16:02.023463 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:02.044901 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1463/2932] 10.222.0.26 () {58 vars in 958 bytes} [Thu Sep 15 11:16:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 11:16:04.842980 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:04.846628 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:04.923072 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103accc9-1a5f-4839-8829-878003f5a428 service nova] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:04.928364 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:04.929071 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:04.929353 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:04.929625 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] PATH_INFO: `/v3/users/2916d230ca9d43fc94dea90a0781973d` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:04.930761 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2916d230ca9d43fc94dea90a0781973d)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:04.932786 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:05.107293 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:05.115252 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2916d230ca9d43fc94dea90a0781973d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.178217 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2916d230ca9d43fc94dea90a0781973d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.178858 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2916d230ca9d43fc94dea90a0781973d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.179513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2916d230ca9d43fc94dea90a0781973d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.189838 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2916d230ca9d43fc94dea90a0781973d'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.213389 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1470/2933] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:16:04 2022] DELETE /identity/v3/users/2916d230ca9d43fc94dea90a0781973d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:16:05.493481 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:05.513491 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116efbad-e9fb-4aa9-bcf2-80e220832e9e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:05.593049 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:05.593713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:05.593971 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:05.594249 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] PATH_INFO: `/v3/projects/9ac3902143404137ba24b2b3d60215e4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:05.596476 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac3902143404137ba24b2b3d60215e4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:05.601986 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:05.724645 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac3902143404137ba24b2b3d60215e4', 'request_id': 'req-0d1a6594-14d6-4763-bb42-6de7474372c9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.734647 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac3902143404137ba24b2b3d60215e4', 'request_id': 'req-0d1a6594-14d6-4763-bb42-6de7474372c9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.795702 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac3902143404137ba24b2b3d60215e4', 'request_id': 'req-0d1a6594-14d6-4763-bb42-6de7474372c9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.810674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] The token cache is being invalidate because project 9ac3902143404137ba24b2b3d60215e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:16:05.811005 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.817027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:05.817027 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1464/2934] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:16:05 2022] DELETE /identity/v3/projects/9ac3902143404137ba24b2b3d60215e4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 11:16:05.818794 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:05.820435 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:05.838471 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752755c7-dfb5-4bcd-8e4a-e67d88e92e3f admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:05.911645 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:05.912453 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:05.912631 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:05.912911 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] PATH_INFO: `/v3/users/0f13075eca424421ba40212b28231beb` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:05.914090 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f13075eca424421ba40212b28231beb)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:05.916475 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:06.124959 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f13075eca424421ba40212b28231beb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.195415 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f13075eca424421ba40212b28231beb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.196033 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f13075eca424421ba40212b28231beb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.196710 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f13075eca424421ba40212b28231beb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.204681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f13075eca424421ba40212b28231beb'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.223223 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1471/2935] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:16:05 2022] DELETE /identity/v3/users/0f13075eca424421ba40212b28231beb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:16:06.465838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:06.467283 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:06.481809 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a6594-14d6-4763-bb42-6de7474372c9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:06.523228 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:06.541716 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:06.542247 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:06.542523 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:06.542794 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] PATH_INFO: `/v3/projects/2a71799bd15448a2a53652104142aa81` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:06.543899 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a71799bd15448a2a53652104142aa81)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:06.545840 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:06.643698 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a71799bd15448a2a53652104142aa81', 'request_id': 'req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.650165 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a71799bd15448a2a53652104142aa81', 'request_id': 'req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.709713 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a71799bd15448a2a53652104142aa81', 'request_id': 'req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.721193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] The token cache is being invalidate because project 2a71799bd15448a2a53652104142aa81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:16:06.721475 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.722204 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:16:06.723649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1465/2936] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:16:06 2022] DELETE /identity/v3/projects/2a71799bd15448a2a53652104142aa81 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:16:16.219298 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:DELETE=15,keystone:SELECT=67,keystone:INSERT=2 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:16.717745 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:17.947330 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:17.948759 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:18.005242 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3796b4b-763b-448c-92b0-4ea72d804e2c admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:18.055690 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538cfa7711a4ebf8868138f8520018a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:18.056299 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:18.056681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:18.056955 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:18.058686 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:18.126479 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:18.127812 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:18.138703 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1472/2937] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:16:20.154712 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:20.156163 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:20.217333 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef3cfa-9382-4d09-8a5d-cc9e7d6d0741 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:20.221311 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:20.221913 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:20.222187 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:20.222458 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:20.224186 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:20.240015 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:20.241488 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:20.252729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1466/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:16:28.133878 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=74 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:30.247621 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=26 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:33.311830 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:33.313280 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:33.325428 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b8b02-d2c1-4ad3-a97a-3128fded9082 service cinder] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:33.329039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:33.329664 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:33.329943 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:33.330214 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:33.331907 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:33.394247 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:33.395617 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:33.406181 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1473/2939] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:16:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:16:35.760800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:16:35.770048 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3f632-2de8-49b8-92a6-c035b07ea208 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:16:35.774043 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:16:35.774648 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:16:35.774927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:16:35.775203 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:16:35.777068 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:16:35.793375 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:16:35.794828 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:16:35.803864 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1467/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:16:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:16:43.401677 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=30 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:16:45.799484 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:18:47.808446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:18:47.822596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c14f-3821-446f-b7c4-551c80ab6e07 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:18:47.822596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:18:47.822596 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:18:47.822905 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:18:47.823153 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:18:47.824954 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:18:47.834717 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:18:47.836623 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:18:47.844915 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1474/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:18:47.918143 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:18:47.926760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa70dd-775b-4ecf-89d6-6c1063b2b5a1 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:18:47.930903 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f259e1d9dd2d47e4af4d4dcdc93eaef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:18:47.931487 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:18:47.931760 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:18:47.932031 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:18:47.933717 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:18:47.948104 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:18:47.949547 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:18:47.960191 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1468/2942] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:18:48.019939 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:18:48.021340 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:18:48.095950 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da515c50-1944-4367-b724-3f20c5cf1744 service neutron] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:18:48.100971 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:18:48.101808 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:18:48.102226 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:18:48.102501 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:18:48.106968 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:18:48.123656 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:18:48.125243 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:18:48.135891 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1475/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:18:49.121413 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:18:49.123117 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:18:49.137409 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50807-a7d8-412e-872c-826cb01668c8 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:18:49.142961 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:18:49.143554 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:18:49.143838 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:18:49.144176 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:18:49.145937 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:18:49.158884 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:18:49.160506 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:18:49.171736 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1469/2944] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:18:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 11:18:58.130755 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=38 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:18:59.166538 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=12 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:20:00.759141 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:00.760590 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:00.773616 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5b364-fcb0-4594-bf1b-182a256bc89f service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:00.779089 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:00.779681 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:00.779956 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:00.780227 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:00.781928 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:00.793914 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:00.795459 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:00.805467 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1476/2945] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:20:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:20:10.801048 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=6 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:20:12.513521 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:12.515460 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:12.530867 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7669b2-513c-4259-bc66-c4b4812613db service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:12.539000 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c2b03530d554c27b1dc3282a5063df4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:12.539649 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:12.539927 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:12.540212 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:12.543193 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:12.557600 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:12.559394 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:12.576779 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1470/2946] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:20:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:20:21.290019 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:21.309857 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809e3d4-a116-41d7-b95f-d21fa2d7083e service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:21.316233 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:21.318917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:21.319219 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:21.319482 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:21.321386 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:21.334597 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:21.336288 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:21.347738 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1477/2947] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:20:22.567062 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:20:24.768414 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:24.780242 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebae6a-8b1f-44b8-9fd5-a7297be73e6b service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:24.785372 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:24.785967 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:24.786251 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:24.786529 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:24.788221 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:24.801239 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:24.802964 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:24.814188 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1471/2948] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:20:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:20:24.913513 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:24.914988 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:24.982413 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366804e0-abd7-4be3-8040-02b0b1460a9b service placement] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:24.986917 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:24.987550 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:24.987829 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:24.988105 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] PATH_INFO: `/v3/users/024c3c41783a48e4bc2d65e198ebcb0c` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:24.989357 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024c3c41783a48e4bc2d65e198ebcb0c)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:24.991248 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:25.218042 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024c3c41783a48e4bc2d65e198ebcb0c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.284283 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024c3c41783a48e4bc2d65e198ebcb0c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.284922 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024c3c41783a48e4bc2d65e198ebcb0c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.285533 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024c3c41783a48e4bc2d65e198ebcb0c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.292790 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024c3c41783a48e4bc2d65e198ebcb0c'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.310581 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1478/2949] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:20:24 2022] DELETE /identity/v3/users/024c3c41783a48e4bc2d65e198ebcb0c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:20:25.583560 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:25.594719 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67750b23-0bf3-45f4-b222-edd84ee16afe service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:25.657674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:25.657674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:25.657674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:25.657674 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] PATH_INFO: `/v3/projects/82df07f4a560481790da3c088446281a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:25.658335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82df07f4a560481790da3c088446281a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:25.658335 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:25.769641 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82df07f4a560481790da3c088446281a', 'request_id': 'req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.775729 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82df07f4a560481790da3c088446281a', 'request_id': 'req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.849752 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82df07f4a560481790da3c088446281a', 'request_id': 'req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.860785 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] The token cache is being invalidate because project 82df07f4a560481790da3c088446281a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:20:25.861075 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.861696 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:25.863265 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1472/2950] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:20:25 2022] DELETE /identity/v3/projects/82df07f4a560481790da3c088446281a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:20:25.867237 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:25.868655 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:25.882403 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746681c-8013-40d9-b4cf-99ff44573c69 admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:25.939028 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:25.939769 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:25.940043 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:25.940331 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] PATH_INFO: `/v3/users/5049ff936c354950a1e7865f0674ad55` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:25.941446 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5049ff936c354950a1e7865f0674ad55)` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:25.943329 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:25.948486 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:20:26.114356 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5049ff936c354950a1e7865f0674ad55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.197736 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5049ff936c354950a1e7865f0674ad55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.198345 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5049ff936c354950a1e7865f0674ad55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.199039 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5049ff936c354950a1e7865f0674ad55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.206301 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.notifications [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5049ff936c354950a1e7865f0674ad55'} {{(pid=81565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.224209 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1479/2951] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 15 11:20:25 2022] DELETE /identity/v3/users/5049ff936c354950a1e7865f0674ad55 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:20:26.462173 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:20:26.463800 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:20:26.478041 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8dd4b-d587-4d2f-8d25-9371dc424d6c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:20:26.535079 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ee61658b90f47ef8962c8e9a5f6c521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcc2355d0a64457f8c16a6298a1d7815', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:20:26.535704 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:20:26.535981 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:20:26.536253 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] PATH_INFO: `/v3/projects/5198b6241f2f4e969f0f8979d4d76f81` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:20:26.537381 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5198b6241f2f4e969f0f8979d4d76f81)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:20:26.539286 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:20:26.561435 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:20:26.680018 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5198b6241f2f4e969f0f8979d4d76f81', 'request_id': 'req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.686721 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5198b6241f2f4e969f0f8979d4d76f81', 'request_id': 'req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.775061 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5198b6241f2f4e969f0f8979d4d76f81', 'request_id': 'req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.786715 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] The token cache is being invalidate because project 5198b6241f2f4e969f0f8979d4d76f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 11:20:26.789910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.789910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1809aa3e-fcb8-450b-88cf-e7f1b144bf8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 11:20:26.789910 dv-cinder-824149-8-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1473/2952] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 15 11:20:26 2022] DELETE /identity/v3/projects/5198b6241f2f4e969f0f8979d4d76f81 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 11:20:36.220582 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:20:36.783585 dv-cinder-824149-8-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 11:25:08.738307 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Authenticating user token {{(pid=81565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 11:25:08.739704 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:25:08.877407 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a942b2-ddbb-4a8b-beb4-8f964128066d admin admin] Validating token access rules against request {{(pid=81565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 11:25:08.933839 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee29a4f477544f63be347989e4b549cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a37f691aef43b18eddf83d65eccbd2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 11:25:08.934431 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] REQUEST_METHOD: `GET` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 11:25:08.934709 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] SCRIPT_NAME: `/identity` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 11:25:08.934979 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 11:25:08.936697 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.fernet_utils [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 11:25:08.947417 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 11:25:08.949002 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd3d04-ffc7-445e-99c6-36ff528c7390 service placement] RBAC: Authorization granted {{(pid=81565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 11:25:08.958544 dv-cinder-824149-8-smb devstack@keystone.service[81565]: [pid: 81565|app: 0|req: 1480/2953] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Sep 15 11:25:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 11:25:18.954437 dv-cinder-824149-8-smb devstack@keystone.service[81565]: DEBUG dbcounter [-] [81565] Writing DB stats keystone:SELECT=89 {{(pid=81565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}